(19) 




III 



(12) 



(43) Date of publication: 

12.01.2000 Bulletin 2000/02 

(21) Application number: 99112837.2 

(22) Date of filing: 02.07.1999 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP 0 971 535 A2 

EUROPEAN PATENT APPLICATION 

(51) mta/: H04N5/76 



(84) Designated Contracting States: 


• Kikuchi, Shinidii, 


AT BE CH CY DE DKESRFR GB GR IE IT LI LU 


Intellectual Property Division 


MCNLPTSE 


Minato-ku, Tokyo 105-8001 (JP) 


Designated Extension States: 


• Taira, Kazuhiko, 


AL LT LV MK RO SI 


Intellectual Property Division 




Minato-ku, Tokyo 105-8001 (JP) 


(30) Priority: 07.07.1998 JP 19206398 


• Ito, Yuji, 


(71) Applicant: 


Intellectual Property Division 


Minato-ku, Tokyo 105-8001 (JP) 


KABUSHIKI KAISHA TOSHIBA 


Kawasaki- shi, Kanagawa 210-8520 (JP) 


(74) Representative: 




Henkel, Feiler, Hanzel 


(72) Inventors: 


Mdhlstrasse 37 


• Ando, Hideo, 


81675 Munchen (DE) 


Intellectual Property Division 


Minato-ku, Tokyo 105-8001 (JP) 





(54) Storage system capable of recording and playing back a plurality of still pictures 



(57) An information storage medium capable of 
recording and playing back still picture information is 
provided with a first information unit (VOB#D, VOB#E) 
having one still picture information, and a first group unit 
(S_VOGI#) which is composed of a set of first informa- 

h — y_voBi# — 



lion units, and has a plurality of pieces of still picture 
information having different contents. Information is 
recorded in the first group unit 
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Description 

[0001 ] The present invention relates to an information 
storage medium capable of recording and playing back 
a plurality of still pictures, a recording method and appa- s 
ratus therefor, and a playback method and apparatus 
therefor. 

[0002] Recently, digital cameras have been preva- 
lently used as media for recording still image informa- 
tion as digital information. In a DVD that records and io 
plays back video information as digital information, 
menu pictures and the like are displayed as still pic- 
tures. 

[0003] In a digital camera, incfividual sensed still pic- 
tures are stored as different files. When each still picture is 
information is saved as an independent file, the follow- 
ing problems remain unsolved. 

a] Since still pictures are not grouped by similarity 

of contents or closeness of image sensing times, it 20 
becomes troublesome to manage and search indi- 
vidual still pictures. 

b] As an example of troublesome management of 
still pictures, different files must be opened to check 
the contents of each still picture information, result- 25 
ing in cumbersome contents checking. 

c] When a plurality of pieces of still picture informa- 
tion are to be processed in a recording/playback 
DVD disc, which assures compatibility and continu- 
ity with a DVD Video disc to some extent, compati- 30 
bility and continuity with the DVD Video disc cannot 

be maintained. 

[0004] Therefore, the present invention has the follow- 
ing objects: 35 

A) an improvement associated with the recording 
format upon recording still picture information on an 
information storage medium; 

B) an improvement associated with the data struc- 40 
ture of management information for still picture 
information recorded on an information storage 
medium; 

C) an improvement associated with an information 
recording/playback apparatus which records still 45 
picture information and its management information 

on an information storage medium; and 

D) an improvement associated with an information 
playback apparatus for playing back still picture 
information and its management information so 
recorded on an information storage medium. 

[0005] More specifically: 

A) It is an object of the present invention to provide 55 
a recording format and a data structure of manage- 
ment information, which are used tar processing a 
plurafity of pieces of still picture information while 



assuring data compatibility and continuity of the 
recording format and management information with 
a general video scheme of a recording/playback 
DVD <fisc that assures compatibility and continuity 
with a DVD Video disc to some extent and an infor- 
mation recording/playback apparatus that can 
implement such recording format and data struc- 
ture. 

B) It is another object of the present invention to 
provide a recording format and data structure of 
management information, which allows easy man- 
agement and search of a plurafity of pieces of 
recorded still picture information, and an informa- 
tion recording/ playback apparatus that can imple- 
ment such recording format and data structure. 

C) ft is still another object of the present invention to 
provide an information playback apparatus which 
allows high-speed access to an information storage 
medium that records a plurality of pieces of still pic- 
ture information so as to continuously display a plu- 
rality of pieces of still picture information (continuity 
upon playback). 

[0008] In order to achieve the above objects, a plural- 
ity of pieces of still picture information are grouped and 
recorded on an information storage medium, thus con- 
tinuously recording the plurality of pieces of still picture 
information. In the group of the plurality of pieces of still 
picture information, at least two still pictures are contin- 
uously recorded at neighboring locations on the infor- 
mation storage medium. 

[0007] Also, management information that pertains to 
the grouped information contains map information, 
which records information which pertains to each still 
picture information (e.g.. the recording address of each 
still picture information on the information storage 
medium). 

[0008] This summary of the invention does not neces- 
sarily describe all necessary features so that the inven- 
tion may also be a sub-combination of these described 
features. 

[0009] The invention can be more fully understood 
from the following detailed description when taken in 
conjunction with the accompanying drawings, in which: 

FIGS. 1A to 1F are views for explaining the data 
structure of an information recording medium 
according to an embodiment of the present inven- 
tion; 

FIG. 2 is a view for explaining the directory struc- 
ture of data files stored in a data area on the 
medium shown in FIGS. 1 A to 1F; 
FIGS. 3A to 3J are views for explaining the data 
structure in an AV file shown in FIG. 2: 
FIG. 4 is a view for explaining an example of the 
sequence (recording location) when a video object 
VOB of AV file data is Recorded on the medium 
shown in FIG. 1; 
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FIG. 5 is a view for explaining the data structure in 
an allocation map table: 

FIG. 6 is a view for explaining the data structure in 
program chain control information (e.g.. user- 
defined PGC information table UD_PGCIT): 5 
FIGS. 7A and 7B are views for explaining playback 
examples of video information (cell information) 
based on program chain PGC; 
FIG. 8 is a view for explaining the data structure of 
management information (video title set information w 
VTSI or management information RTR_VMGI for 
video real-time recording); 

FIGS. 9A to 9F are views for explaining the order of 
sequence of video object VOBs according to video 
object information (MVOBI for a moving picture or is 
S_VOGI for a still picture); 

FIGS. 10A to 10L are views for explaining the 
recording format of a picture object/audio object for 
a still picture; 

FIG. 1 1 shows a screen display example of picture 20 
object data (still picture) played back from the 
medium shown in FIG. 1 ; 

FIG. 12 is a view for explaining the data structure of 
information that pertains to a video object in a still 
picture AV file (S_AVFIT) shown in FIG. 8; 25 
FIG. 13 is a view for explaining the data structure 
(the data structure that pertains to S_VOGI in FIG. 
9) of a video object unit VOBU in a picture object; 
FIGS. 14A to 14G are views for explaining the rela- 
tionship between the data structure in a VOB upon 30 
continuously recording still pictures, and the desig- 
nation contents of a corresponding cell; 
FIG. 15 is a view showing an example of the corre- 
spondence among the data structure cefl playback 
information (cell information S_CI for a still picture) 35 
of a picture object the contents of the cell playback 
information, and components shown in FIGS. 14A 
to14G; 

FIG. 16 is a view showing an example of another 
data structure of celt playback information (cell 40 
information CI) of a picture object; 
FIG. 1 7 is a view for explaining the data structure of 
partjoMitle (chapter) information that pertains to a 
still picture in AV file information (S_AVFI) for a still 
picture; 45 
FIG. 18 is a view for explaining the data structure of 
a VOB map of the picture object shown in FIG. 17; 
FIG. 19 is a block diagram showing an example of 
the arrangement of a digital video recording/play- 
back apparatus (RTR video recorder) using the so 
medium (a DVD_RTR disc capable of record- 
ing/playing back a video in real time) shown in FIG. 
1; 

FIG. 20 is a flow chart for explaining the sequence 
for recording one or more still pictures on the ss 
medium shown in FIG. 1 ; 

FIG. 21 is a flow chart showing the sequence when 
audio information is after-recorded on the medium 



shown in FIG. 1 ; 

FIG. 22 is a flow chart showing the sequence when 
one or more still pictures are played back from the 
medium shown in FIG. 1; 

FIG. 23 is a view for explaining the data structure of 
control information/navigation data (RTR_VMG) 
shown in FIG. 1E or FIG 8; 
FIG. 24 is a view for explaining the contents of still 
picture cell information (S_CI) shown in FIG. 23; 
FIG. 25 is a view for explaining the contents of still 
picture cell general information (S_C_J3I) shown in 
FIG. 24; 

FIG. 26 is a view for explaining the contents of each 
still picture cell entry point (S_C_EPI) shown in 
FIG. 24; 

FIG. 27 is a view for explaining the contents of still 
picture additional audio file information (S__AAFI) 
shown in FIG. 12; 

FIG. 28 is a view for explaining the contents of 
S_AAG general information (S_AAG_GI) shown in 
FIG. 27; 

FIG. 29 is a view for explaining the contents of an 
additional audio entry (AA_ENT) shown in FIG. 27; 
FIG. 30 is a view for explaining the contents of still 
picture VOB group general information 
(S_VOG_GI) shown in FIG. 12; 
FIG. 31 is a view for explaining the first example 
(type 1) of the contents of a still picture VOB entry 
(S_VOB_ENT) shown in FIG 12; 
FIG. 32 is a view for explaining the second example 
(type 2) of the contents of a still picture VOB entry 
(S_VOB_ENT) shown in FIG. 12; 
FIG. 33 is a view for explaining the third example 
(type 3) of the contents of a still picture VOB entry 
(S_VOB_ENT) shown in FIG. 12; 
FIG. 34 is a view for explaining the fourth example 
(type 4) of the contents of a still picture VOB entry 
(S_VOB_EN7) shown in FIG. 12; 
FIG. 35 is a view for explaining the relationship 
between original PGC information (ORG_PGCI 
shown in FIG. 8 or 23) and a still picture video file 
(RTR_STO.VRO shown in FIG. 2) when a still pic- 
ture VOB alone "is recorded; 
FIG. 36 is a view for explaining the relationship 
between original PGC information (ORG_PGCI) 
and a still picture additional audio part 
(RTR_STA.VRO shown in FIG. 2); 
FIG. 37 is a 'view for explaining the relationship 
among a still picture VOB. movie VOB, and original 
PGC information; and 

FIG. 38 is a view for explaining a case wherein 
user-defined PGC Information (FIG. 6) looks up a 
still picture VOB group. 

[0010] Preferred embodiments of the present inven- 
tion will be described hereinafter with reference to the 
accompanying drawings. 
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[1] Outline of Data Structure on Information Storage 
Medium 

[001 1 J The recording information contents (data struc- 
ture) of information recorded on an information storage s 
medium (Optical Disc or DVD RTR disc 1001) that can 
record and play back video information and music infor- 
mation shown in FIG. 1 A will be explained below. 
[0012] The data structure of information recorded on 
the information storage medium (optical disc 1001) is io 
roughly divided, in the order from inner side 1006 in 
FIG. IB. into: 

* lead-in area 1 002 having an embossed data zone 
whose light reflection surface has an embossed is 
pattern, a mirror zone whose surface is flat (mirror 
surface), and a rewritable data zone capable of 
information rewriting; 

•volume & file manager information 1003 that 
records information which is recorded on a rewrite- 20 
We data zone which can be recorded/rewritten by 
the user, and pertains to the entire file or volume of 
audio & video data; 

* data area 1 004 made up of a rewritable data zone 
that can be recorded/rewritten by the user; and 25 

* lead-out area 1005 made up of a rewritable data 
zone capable of information rewriting. 

[001 3] The embossed data zone of lead-in area 1 002 
records in advance: 30 

•information such as the disc type indicating a 
DVD-ROM. DVD-RAM. DVD-R. or the like, disc 
size, recording density, physical sector numbers 
indicating the recording start/end positions, and the 35 
tike, which pertain to the entire information storage 
medium; 

•information such as the recording power and 
width, erase power, playback power, and linear 
velocity upon recording and erasure, which pertain ao 
to the recording/ playback/erasure characteristics; 
and 

•information such as the manufacturing number 
aid the like, which pertain to the manufacture of 
each information storage medium. 45 

[0014] The rewritable data zone of each of lead-in and 
lead-out areas 1002 and 1005 has a unique disk name 
recording field for each information recording medium, a 
test recording field (for confirming recording/ erasure so 
conditions), and a management information recording 
field that pertains to a defective field in data area 1004. 
and an information recording/playback apparatus can 
record information on these fields. 

[0015] Data area 1004 sandwiched between lead-in 55 
and lead-out areas 1002 and 1005 can record both 
computer data and audio & video data, as shown in FIG. 
1C. The recording order, each recording information 



size, and the like of computer data and audio & video 
data can be arbitrary determined. Locations where the 
computer data are recorded will be referred to as com- 
puter data areas 1006 and 1010. and a location where 
the audio & video data are recorded will be referred to 
as audio & video data area 1009 hereinafter. 
[001 6] As shown in FIG. 1 D, the data structure of infor- 
mation recorded in audio & video data area 1009 con- 
tains: 

• anchor pointer for control information 1015: infor- 
mation indicating the start location (start address) 
where control information 101 1 is recorded in audio 
& video data area 1009; 

• control information 101 1 : control information (cor- 
responding to RTR.IFO shown in FIG. 2) required 
upon executing respective processes, i.e., video 
recording (audio recording), playback, editing, and 
search; 

• video objects 1012: video recording information of 
video data contents; 

• picture objects 1013: still picture information such 
as still pictures, slide pictures, and the like; 

•audio objects 1014: audio recording information 
of audio data contents; 

•thumbnail objects 1016: information such as 
thumbnails used upon searching for a location the 
user wants to watch or upon editing; and so on. 

[0017] Video objects 1012, picture objects 1013. 
audio objects 1014, and thumbnail objects 1016 shown 
in FIG. 1 D mean groups of information classified in units 
of contents (data contents). Hence, all pieces of video 
information recorded on audio & video data area 1009 
are contained in video objects 1012. all pieces of still 
picture information are contained in picture objects 
1013, all pieces of audio information are contained in 
audio objects 1014. and all pieces of thumbnail informa- 
tion used in video information management and search 
are contained in thumbnail objects 1016. 
IP018] VOB (video object) 1403 shown in FIG. 3D (to 
be described later) indicates a cluster of information 
recorded in AV file (i.e.. audio & video fie) 1401, and 
has a definition different from that of video objects 1012 
shown in FIG. 1D. Note that similar terms often have 
quite different meanings. 

[0019] Furthermore, as shown in FIG. 1E, the con- 
tents of control information 101 1 include: 

*AV data control information 1101: management 
information which manages the data structure in 
video object 1012 or manages information that per- 
tains to the recording locations on optical disc 1001 
as an information storage medium: 
•playback control information 1021: control infor- 
mation required upon playback; 
recording control information 1022: control informa- 
tion required upon recording (video/audio record- 
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ing); 

•edit control information 1023: control information 
required upon editing; 

•thumbnail control information 1024: management 
information that pertains to thumbnails (thumbnail s 
object) used to search for a location the user wants 
to watch in video data or to edit; and the (ike. 

[0020] Note that Control information 1101 and play- 
back control information 1021 shown in FIG. 1E corre- w 
spond to RTR.IFO shown in F1GL 2, and RTR_VMG 
shown in FIG. 23. 

[0021] As shown in FIG. 1 F. the data structure in AV 
data control information 1 101 shown in FIG. 1 E is com- 
prised of: is 

• allocation map table 1105: information which per- 
tains to address setups along the actual layout 
identification of recorded/unrecorded areas, and 
the like on the information storage medium (optical 20 
disc 1001); 

•video title set information 1 106: time information 
(corresponding to RTR_VMGI in FIG. 8) which indi- 
cates the overall information contents in AV file 
1401 shown in FIG. 3A, and includes link informa- 25 
tion among VOBs. grouping information of a plural- 
ity of VOBs for management and search, a time 
map table, and the like: 

• video object information 1 107: information (corre- 
sponding to M_AVFlT/S_AVFIT in FIG. 8 or 30 
S_AVFIT in FIG. 12) which indicates information 
pertaining to each VOB in AV file 1401. and per- 
tains to attribute (characteristic) information in units 

of VOBUs, and each VOBU contained in the VOB; 

• PGC control information 1 103: information (corre- 35 
sponding to PGCI in FIG. 23) that pertains to a 
video information playback program (sequence); 
and 

•cell playback information 1108: information (cor- 
responding to CI in FK3L 23 or S_CI in FIG. 24) that 40 
pertains to the data structure of a basic video infor- 
mation unit upon playback. 

[0022] The aforementioned contents are a brief expla- 
nation of the data structure shown in FIGS. 1A to 1F. 45 
Some additional explanations of each information will 
be given below. 

[0023] Volume & file manager information 1003 
records: 

so 

• information that pertains to the entire volume; 

: • the number of files of contained PC data, and the 
number of files associated with AV data; 
•information associated with recording layer infor- 
mation and the like. 55 

[0024] Especially, as the recording layer information, 
information 1003 records: 



• the number of layers that form a disc (e.g.. a sin- 
gle RAM/ROM two-layered disc has two layers, a 
single ROM two-layered disc also has two layers, 
and n single-sided discs are counted as n layers); 

• a logical sector number range table (capacity in 
units of layers) assigned in units of layers; 

• the characteristics (e.g.. a DVD-RAM disc, a RAM 
section of a RAM/ROM two-layered disc, a CD- 
ROM, a CD-R. and the like) in units of layers; 

an assigned logical sector number range table 
(including rewritable area capacity information of 
each area) in units of zones on a RAM area of each 
layer; and 

• unique ID information of each layer (e.g.. to find 
out a disc exchange event in a multi-disc pack). 
With this information, continuous logical sector 
numbers can be set even for a mufti-disc pack or 
RAM/ROM two-layered disc to handle such discs or 
disc as a single, large volume space. 

[0025] Playback control information 1021 records: 

• information that pertains to a playback sequence 
which combines PGCs; 

• information (a sequence for continuously playing 
back all recorded cells) indicating a pseudo record- 
ing location considering the information storage 
medium as a single tape like a VTR or DVC in rela- 
tion to the above information; 

•information that pertains to simultaneous play- 
back on a plurality of screens having different kinds 
of video information; 

• search information: information which records cell 
IDs corresponding to search categories, and a table 
of start times in a given cell, and allows the user to 
select and directly access the video information of 
interest; and the like. 

[0026] Recording control information 1022 records: 

•program reservation recording information and 
the like. 

[0027] Furthermore, edit control information 1023 
records: 

special edit information in units of PGCs (corre- 
sponding time, setup information and special edit 
contents are descrfced as EDL information); and 
file conversion information (which converts a spe- 
cific field in an AV file into a file such as an AVI file 
that can undergo special editing on a PC, and des- 
ignates the storage location of the converted file). 

[0028] Thumbnail control information 1024 describes: 

• management information that pertains to thumb- 
nail objects 1016 (designation information of the 
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recording location of each thumbnail picture in 
audio & video data area 1009 and a VOB or cell 
associated with each thumbnail picture, location 
information in a VOB or cell associated with each 
thumbnail picture, and the like (the VOB and cell will 
be explained in detail later upon explaining the con- 
tents of FIGS. 3A to 3J)). 

[0029] The cfirectory structure of data files in the data 
area will be described below. 

[0030] All pieces of information are recorded in units 
of files in data area 1 004 in FIG. 1 B. and the relationship 
among data files is managed by the directory structure 
shown in FIG. 2. 

[0031] Referring to FIG. 2, a plurality of subdirectories 
1451 are contained within root directory 1450 to allow 
easy classification in units of recorded file contents. In 
the embodiment shown in FIG. 2, data files that pertain 
to computer data recorded on computer data areas 
1008 and 1010 shown in FIG. 1C are recorded under 
subdirectory 1457 lor computer data storage, and audio 
& video data recorded on audio & video data area 1 009 
are recorded under rewritable video title set RW VTS 
1452. On the other hand, upon copying video informa- 
tion recorded on a DVD Video disc or (DVD Audio disc) 
to the disc shown in FK3. 1A. data are copied under 
video title set VIDEO_TS 1455. and audio title set 
AUDH3TS 1456. 

[0032] Control information 1 0 1 1 in FIG. 1 D is recorded 
as a single file for recording/playback video manage- 
ment data. In the embodiment in FIG. 2, that information 
has file name RW_VIDEO_CONTROL IFO (or real time 
recording information; abbreviated as RTR.IFO). Fur- 
thermore, identical information is also recorded as 
backup information with file name 
RW_VIDEO_CONTROLBUR 

[0033] In the embodiment shown in FIG. 2, all of video 
objects (RTR_MOVVRO) 1012. picture objects 
(RTR_STO.VRO) 1013. audio objects ( RTR_STA. VRO) 
1014. and thumbnail objects 1016 are recorded as sin- 
gle AV ffle 1401 (the file name in the embodiment in 
FIG. 2 is RWJDBJECT.OB). 

[0034] Rewritable additional information 1454 (not 
shown in FIGS. 1Ato1F) that can be used upon record- 
ing/ playing back video information can be simultane- 
ously recorded. That information is recorded as a single 
file, which has file name RW_ADD.DAT (corresponding 
to S_AA_STI/S_AAF1 in FIG. 12 or AA_ENT in FIG. 27) 
in the embodiment in FIG. 2. 

[0035] FIGS. 3A to 3J show an example of the data 
structure in an AF file. As shown in FIG. 3B. entire AV 
ffle 1401 forms single VTS (video title set) (or RTR 
movie object RTR_MOVVRO) 1402. VTS 1402 con- 
tains a group of a plurality of VOBs (video objects) 1403. 
1404, and 1405. which are separated into a plurality of 
part_of_titles (or a plurality of chapters) 1407 and 1408 
in accordance with the contents of audio & video data 
and the order of information recorded in AV f ile 1 401 . 



[0036] VOBs 1403, 1404, and 1405 in FIG. 3D are 
defined as sets of audio & video data recorded in AV file 
1401. and have definition contents different from video 
objects 1012 shown in FIG. 1D that primarily serve the 

5 purposes of classification items of video information/ 
still picture information/audio information/thumbnail 
information and the Oka Hence, VOBs 1403, 1404, and 
1405 in FIG. 3D record not only information classified 
into video objects 1012, but also information classified 

10 into picture objects 1013, audio objects 1014. and 
thumbnail objects 1016. as shown in FIG. 10. 

[0037] Associated VOBs are grouped into a plurality of 
PTTs (part_of_tit!es or chapters) 1407 and 1408 based 
on information contents recorded in VOBs 1403. 1404, 

is and 1405. That is, PTTs 1407 and 1408 are formed as 
sets of one or a plurality of VOBs. In the embodiment 
shown in FIG. 3C. PTT 1408 is formed by two VOBs. 
i.e., VOBs 1404 and 1405. and PTT 1407 is formed by 
one VOB 1403 alone. 

20 [0038] Minimum basic units of video information are 
called VOBUs (video object units) 1411 to 1414. and 
data in VOBs 1403 to 1405 are formed as sets of 
VOBUs 141 1 to 1414, as shown in F1GL 3E. 
[0039] MPEG1 or MPEG2 is prevalently used as the 

25 video information compression technique in VOBs 1 403 
to 1405. MPEG segments video information into groups 
called GOPs in 0.5-sec increments, and compresses 
video information in units of GOPs. Video information 
compression units of VOBUs 141 1 to 1414 are formed 

so to have nearly the same size as that of GOP in synchro- 
nism with GOR 

[0040] Furthermore, VOBUs 1411 to 1414 are 
recorded while being segmented into sectors 1431 to 
1437 in units of 2,048 bytes. Sectors 1431 to 1437 

35 record raw video information, sub-picture information, 
audio information, and dummy information in units of 
packs in the form of pack structures, i.e., V__PCKs 
(video packs) 1421, 1425, 1426. and 1427, SP_PCK 
(sub-picture pack) 1422, A_PGK (audio pack) 1423, 

40 and DM_PCK (dummy pack) 1424. Each dummy pack 
size is 2,048 bytes. However, since each pack has a 14- 
byte pack header at the start of it, the information size 
recorded in each pack is 2,034 bytes. 
[0041] Note that DM_PCK (dummy pack) 1424 is 

45 inserted for the purposes of: 

addition of information to be additionally recorded 
after video recording (for example, memo informa- 
tion indicating that after-recording information is 
so inserted into an audio pack and replaced by a 
dummy pack is inserted in sub-picture information 
(a sub-picture pack) and is replaced by a dummy 
pack). 

55 [0042] The recording area of a DVD-RAM (DVD__RTR) 
disc as an example of the information storage medium 
(optical disc 1001) shown in FIG. 1A is segmented into 
a plurality of sectors. 2,048 -byte data can be recorded 
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per sector. In this DVD -RAM, disc recording/playback is 
done in units of sectors (2,048 bytes). Hence, when a 
DVD-RAM disc is used as the information storage 
medium (optical disc 1001). the respective packs are 
recorded in units of sectors 1431 to 1437, as shown in 
FIG. 3R 

[0043] As shown in FIGS. 3B and 3D, VTS (video title 
set or RTR_MOVVRO) 1402 is formed by a sequence 
of all VOBs 1403 to 1405 in AV file 1401 . By contrast, a 
playback sequence described in playback control infor- 
mation (pack control information) 1021 can designate 
an arbitrary range in an arbitrary VOB, and can play it 
back in an arbitrary playback order. 
[0044] Basic video information units upon playback 
are called cells 1441, 1442, and 1443. Each of cells 

1441. 1442, and 1443 can designate an arbitrary range 
in an arbitrary VOB. but cannot make designation 
across a plurality of VOBs (one cell cannot set a range 
by linking a plurality of VOBs). 

[0045] In the embodiment shown in FIG. 3G. cell 1441 
designates one VOBU 1412 in VOB 1403. ceil 1442 
designates whole VOB 1404, and cell 1 443 designates 
the range of only a specific pack (V_PCK 1427) in 
VOBU 1414. 

[0046] Information indicating a video information play- 
back sequence is set by PGC (program chain) 1446. 
and is described by designating a single cell or by link 
information of a plurality of cells. For example, in the 
embodiment shown in FIG. 3H, PGC (program chain) 
1446 forms a playback program as a link of cells 1441, 

1442, and 1443 (the relationship between the ceH and 
PGC will be described in detail later). 

[0047] VOBU 1403 in FIG. 3D can contain not only 
video information but also audio information. In this 
case, VOBU 1411 that forms VOB 1403 contains 
V_PCK 1421 and SP_PCK 1422 that construct a video 
part, and A_PCK 1423 and DM_PCK (for after record- 
ing) 1 424 that construct an audio part. 
[0048] The video part is formed by a sequence header 
and GOP header composed of some contents on the 
start side of V_PCK MPEG l-picture composed of the 
contents of a V_PCK group, a sequence end code com- 
posed of some contents on the end side of V_PCK, and 
sub-picture unit SPU composed of the contents of 
SP_PCK. 

[0049] The audio part contains audio data to be 
played back in synchronism with still picture playback 
using l-picture of the video part, and is comprised of one 
or more aucfio frames. 

[0050] The contents of allocation map table 105 in 
FIG. 1 F will be described below with reference to FIG. 4. 
[0051] As described above, the recording area of the 
DVD-RAM disc is segmented into a plurality of sectors, 
and logical sector numbers (LSNs) are continuously 
assigned in ascending order from the inner side. 
[0052] A case will be examined below wherein video 
information is recorded in data area 1004 of the infor- 
mation storage medium (optical disc 1001) in the follow- 



ing sequence 

1. An area for recording AV file 1401 is assured in a 
continuous area (a < g) from logical sector numbers 

s (LSN) a+1 to g in data area 1004 on the information 

storage medium (optical disc 1001). 

2. Data of VOB#1 1461 is recorded in a continuous 
area (b < c) from logical sector numbers (LSN) b+1 
to c in the area for recording AV file 1401 . 

w 3. Data of VOB#2 1 462 is recorded in a continuous 
area (d < e) from logical sector numbers (LSN) d+1 
to e in the area for recording AV file 1401 . 

As a result of the above processes in 1 . to 3.. 
three unrecorded areas "from a+1 to b~, "from c+1 

15 to d", and "from e+1 to g" in logical sector numbers 
(LSN) remain in AV file 1401. When video informa- 
tion of VOB#3 with a large data size is recorded in 
these unrecorded areas, the following processes 
are required. 

20 4. Data of VOB#3 is segmented into a plurality of 
data in correspondence with the unrecorded area 
sizes in the area for recording AV file 1401. 

5. First segmented data 1463 of VOB#3 is recorded 
in a continuous area (a < b) from logical sector 

25 numbers (LSN) a+1 to b. 

6. Next segmented data 1 464 of VOB#3 is recorded 
in a continuous area (c < d) from logical sector num- 
bers (LSN) c+1 to d. 

7. Last segmented data 1465 of VOB#3 is recorded 
30 in a continuous area (f < g) from logical sector num- 
bers (LSN) f+1 to g. 

[0053] As a result, unrecorded area 1460 "from e+1 to 
f in logical sector numbers (LSN) remains in AV ffle 
35 1401 . FIG. 4 shows the distribution of physical recorded 
positions of VOBs in AV file 1401 as a result of the 
above processes in 1 . to 7. 

[0054] As can be seen from the above description, 
when data in AV file 1401 is partially erased or when 
40 new data is additionally recorded in an unrecorded area 
in AV file 1401, single VOB data must be segmented 
and recorded at a plurality of locations like data 1463, 
1464, and 1465 of VOB#3. 

[0055] Allocation map table 1105 shown in FIG. IF 
45 shows information indicating the distribution of physical 
positions of identical data distributed and recorded in 
AV file 1401 in units of VOBs. FIG. 5 shows the informa- 
tion contents of allocation map table 1105 taking the 
data allocation shown in FIG. 4 as an example. Alloca- 
so tion map tabl e 1 1 05 is comprised of distribution informa- 
tion 1621 of positions of unrecorded areas, and a 
plurality of pieces of distrftxition information 1622. 1623. 
and 1 624 of positions of recorded data in units of VOBs. 
[0056] A cluster of data units having continuous logi- 
55 cal sector numbers in each VOB will be defined as an 
"extent'. In the embodiment shown in FIG. 4. data of 
VOB#3 are recorded as three extents. In the above 
example, since an area from Jogical sector numbers a+1 
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to b has continuous logical sector numbers, the area 
forms "extent#y 1473". That is. the recording positions 
of the data of VOB#3 are distributed to three locations, 
i.e.. extents 1473. extent#5 1474. and extents 1475. 
[0057] The position distribution information that per- 
tains to unrecorded areas or each VOB in allocation 
map table 1105 shown in FIG. 5 records the number 
1601. 1602. 1603, or 1604 of extents at its first position. 
After that, first address 1606, 1607. 1608. 1609, 1610, 
or 1611 and size 1614. 1615, 1616. 1617, 1618. or 1619 
of each extent are recorded. The first address is 
expressed by a "differential number" (or relative sector 
number) from the first logical sector number of AV ffle 
1 401 . When each first address is expressed by a differ- 
ential number, if the entire contents of AF file 1401 are 
transplanted to another information recording medium, 
information in allocation map table 1105 need not be 
changed, thus improving file portability. In FIG. 5. the 
extent size is expressed by the number of sectors. The 
extent size may be expressed by the last address of 
each extent in place of the number of sectors in FIG. 5. 
[0058] In the DVD-RAM disc (DVD_RTR cfisc) format 
information indicating a physical address on the infor- 
mation storage medium (optical disc 1001) is called a 
physical sector number (PSN), the entire address used 
by the file system is called a logical sector number 
(LSN). and an address defined on the file system in data 
area 1004 in FIG. 1A is called a logical block number 
(LBN), thus distinguishing PSN. LSN. and LBN from 
each other. However, if this convention is always 
observed, the description becomes complicated. For 
this reason. FIG. 5 uses an expression based on logical 
sector numbers (LSN) for the sake of easy understand- 
ing. 

[0059] The contents of playback control information 
1021 will be described below with reference to FIGS. 6 
to 7B. PGC (program chain) control information 1103 in 
playback control information 1021 has the data struc- 
ture shown in FIG. 6. and the playback order is deter- 
mined by PGC and cells. PGC is a unit that designates 
the playback order of cells and executes a given play- 
back sequence. On the other hand, each cell indicates 
a playback period that designates playback data in each 
VOB by the start and end addresses, as shown in FIGS. 
3D to 3F 

[0060] PGC control information 1 103 is composed of 
PGC information management information 1052, one or 
more search pointers 1053 and 1054 of PGC informa- 
tion, and a plurality of pieces of PGC Information 1055, 
1056, and 1057. 

[0061] PGC information management information 

1 052 contains information (number of PGC information) 
indicating the number of PGCs: Each of search pointers 

1053 and 1054 of PGC Information points to the first 
position of each PGC information, and allows an easy 
search. Each PGC information 1055. 1056. or 1057 
consists of PGC general information 1061 . one or more 
pieces of program information (PGI#m). one or more 



cell IDs (or CI_SRP#m). and one or more pieces of cell 
information (Cl#m). PGC general information (PGC_GI) 
1061 contains information (number of eel! playback 
information) indicating the playback time of PGC and 
5 the number of cefls. Or PGC_G1 1061 may contain infor- 
mation indicating the number of programs (PGs) and 
the number of search pointers (CI_SRP) of cell informa- 
tion. 

[0062] As shown in FIG. 7 A, playback data are desig- 
10 nated as a playback period in units of cells from cell -A to 
cell-F, and PGC information is defined in each PGC. 

1. PGC#1 exemplifies a case wherein it is com- 
posed of cells that designate a continuous playback 

15 period, and its playback order is cell-A -> cell-B -> 
cell-C. 

2. PGC#2 exemplifies a case wherein it is com- 
posed of cells that designate an intermittent play- 
back period, and its playback order is cell-D cefl- 

20 E ~> cell-F. 

3. PGC#3 exemplifies a case wherein playback can 
be done intermittently irrespective of the direction of 
playback or repetitive playback, and its playback 
order is cell-E -> cell-A cell-D -> cell-B cell-E. 

25 

[0063] Control information (RTR.IFO) 101 1 shown in 
FIG. 1 D or 2 contains navigation data RTR_VMG (real 
time recording video manager) corresponding to control 
information 1101 and control information 1021. as 

30 shown in FIG. 1E. This RTRVMG contains video title 
set information VTSI (or information RTRVMGI of 
RTR_VMG) 1 106. as shown in FIG. 1 F 
[0064] This information (RTR_VMGI) 1 106 contains 
information used upon playing back a sequence of 

35 VOBs 1403. 1404, 1405. .... shown in FK3L 3D. 

[0065] The data structure and contents of RTR VMG 
in FIG. 1E (or RTR.IFO in FIG. 2) will be explained 
below with reference to FIG. 8. 

[0066] As shown in FIG. 8. navigation data RTR_VMG 
40 (control information RTR.IFO) is comprised of RTR 
video manager information (RTR_VMGI). a movie AV 
ffle information table (M_AVFIT), a still picture AV file 
information table (S_AVFIT), original PGC information 
(ORG_PGCI). a user-defined PGC information table 
45 (UD_PGCIT), a text data manager (TXTDT_MG), and a 
table (MNFIT) of information that pertains to the manu- 
facturer. 

[0067] RTR_VMGI contained in this RTR_VMG corre- 
sponds to video title set (VTS) information 1 106 shown 

so in FIG. 1F. 

[0068] This information (RTR_VMGI) 1 1 06 contains 
VTS general information 1751. VOB sequence informa- 
tion 1752. PTT information 1753. and VTS time map 
table 1754. as shown in FIG. 8. 

55 [0069] Put otherwise, this information (RTR_VMGI) 
1106 contains a play list search pointer table 
(PL_SRPT) corresponding tp VOB sequence informa- 
tion 1752. and a video manager information manage- 
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merit table (VMGI_MAT) corresponding to VTS general 
information 1751. 

[0070] Table PL_SRPT contains information 1756 
indicating the number of VOBs in VTS (or the number of 
play list search pointers and the end address of 
PL_SRPT), information 1757 indicating the ID of the 
first VOB in a VOB sequence (or first play Ost search 
pointer PL_SRP#1). information 1758 indicating the ID 
of the second VOB in the VOB sequence (or second 
play Ost search pointer PL_SRP#2). and the like. 
[0071] Each play list search pointer (PL_SRP) con- 
tains information (PL_TY) indicating the type of a play 
list PGC number information (PGCN) corresponding to 
this play list information (PL_CREATE_TM) indicating 
the date of creation of this play fist, information 
(PRMJTXTI) of primary text associated with this play 
list number information (H_TXTI_SRPN) of a search 
pointer of item text used in this play list, and thumbnail 
pointer information (THM_PTRI) indicating a thumbnail 
picture corresponding to the recording contents of this 
play list 

[0072] The table (PL_SRP7) that contains these 
pieces of information 1756, 1757, 1758.... corresponds 
to VOB sequence information 1752 contained in VTSI 
(RTR_VMGI) 1106. 

[0073] The contents of VTSI (RTR_VMGI) 1 106 can 
be summarized as follows. 

[0074] That is, as shown in FIG. 8. the data structure 
in video title set information (or RTR_VMGI) 1106 
records: 

•video title set general information 1751 ... This 
information pertains to general contents of a video 
title set (or RTR data in AV ffle 1 401 in RGL 2); 
•video object sequence information 1752 ... In the 
data structure shown in FIGS. 3A to 3J, serial num- 
bers are set for all VOBs in video title set 1402 (= 
AV file 1401). This information describes serial 
number information of VOBs according to this 
sequence; 

• part_of_titles information 1753 ... Object data 
recorded in AV file 1401 are grouped in units of 
: associated data for the purpose of each data man- 
agement and search, and video title names are set 
in units of groups. The group (part_of_title) is 
formed of a set of VOBS. This information 
describes VOB information contained in each 
part_of__trtle; and 

•video title set time map table 1754 ... This infor- 
mation pertains to VOBU position information at 
specific time intervals according to the video object 
, sequence in relation to VOBs which are classified 
into video objets 1012 and audio objects 1014 in 
video title set 1402. 

[0075] The detailed data structure in video object 
sequence information 1 752 is shown on the right side in 
FIG. 8. That is, the total number 1756 of VOBs (or 



PL_SRPTI) contained in the video title set is recorded at 
the first position. After that VOBJDs (or PL_SRP#1. 
PL_SRP#2. ... PL_SRP#n) 1757, 1758. .. correspond- 
ing to serial numbers are recorded in the sequence 

5 (video object sequence) order. 

[0076] The sequence indicated by video object 
sequence information 1 752 can be arbitrarily set by the 
user or information recording/playback apparatus side 
in, eg., "the recording order to AV file 1401 (ascending 

io order of recording time)", "the recording allocation order 
on the information storage medium (optical disc) shown 
in FIG. 4", the VOB size order-, and the like. By 
sequentially determining the order of all VOBs in VTS 
(video title set) 1402, a user interface similar to a VTR 

15 that records video data on a single table can be pro- 
vided. 

[0077] For example, the following processes can be 
done using video object sequence information 1 752: 

20 • to search for a scene the user wants to watch by 

fast-forwarding (FF) or rewinding (FR) a tape; 
• to confirm the entire recording contents by fast- 
forwarding (FF) the tape; and 
•to search for an unnecessary recorded scene by 
25 fast-forwarding (FF) or rewinding (FR) the tape, and 
to overwrite new video information on that scene. 

[0078] The information contents of video object 
sequence information 1752 shown on the right side in 

30 FIG. 8 will be explained below with reference to FIGS. 
9A to 9F. A case will be examined first wherein VOB#1 
to VOB#3 are recorded to have the allocation order on 
the information storage medium (optical disc) shown in 
FIG. 4, and this recording is done in the order of 1 . to 7. 

35 descrfoed in "description of allocation map table con- 
tents". FIG. 9C shows the sequence order which is set 
for these data in "the recording order to AV file 1.401 
(ascending order of recording time)". Compared to FIG. 
4. the allocation order from extent#a 1471 to extent^ 

40 1470 has changed. "First VOBJD 1757 in the video 
object sequence" shown in FIG. 8 designates "V0B#1 
1461" in FIG. 9C. and "second VOBJD 1758 in the 
video object sequence" designates "VOB#2 1462" in 
FK3L9C. 

45 [0079] FIG. 9F shows another embodiment desig- 
nated by video object sequence information 1752. 
VOB#A 1771 and VOB#B 1772 belong to (are classified 
to) video objects "(movie VOB information M_VOBI#) 
1012, VOB#C 1773. VOB#F 1776, and VOB#G 1777 to 

so audio objects 101 4, and VOB#D 1774 and VOB#E 1775 
to picture objects (still picture VOB group information 
S_VOGI#) 1013. In this way, the sequence order can be 
designated independently of the VOB types. In FIG. 9F, 
VOBs (VOB#H 1778 and VOB#l 1779) that belong to 

55 thumbnail objects 1016 are set at the end of the 
sequence. 

[0080] The recording format upon recording still pic- 
ture information on the information storage medium 
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(optical disc 1001) shown in FIG. 1A will be explained 
below. 

[0081] Still picture information or audio information 
(information that additionally records audio data of a 
comment for each still picture information by after s 
recording) to be added later to still picture information 
are recorded at a location of picture objects 1013 or 
audio objects 1016 in FIG. 1D. For example, the format 
is designed to be capable of continuously recording a 
plurality of still pictures assuming that a plurality of still io 
pictures sensed by a digital camera are recorded on the 
information storage medium (optical disc 1001) at one 
time. In order to allow to continuously record a plurality 
of still pictures, the format is designed to record at least 
two still pictures at neighboring locations on the infor- is 
mation storage medium (optical cfisc 1001). 
[0082] A still picture or audio information to be added 
to the still picture follows the data structure shown in 
FIGS. 3A to 3J to attain format continuity and matching 
with video information (video objects 1012). In MPEG1 20 
or MPEG2 as one type of recording format (video infor- 
mation compression format) of video information, com- 
pressed information for one corresponding video frame 
is present at the start position of the aforementioned 
GOP in the form of "l-picture". 25 
[0083] As shown in FIGS. 10C and 101. input still pic- 
tures are converted into l-pictures 1706. 1707. 1708, 
and 1709 using the MPEG1 or MPEG2 compression 
technique, and these l-pictures are recorded on the 
information storage medium (optical disc 1001) while 30 
being stored in V_PCKs (video packs) 1661. 1662. 
1663, 1668, 1669, 1670. 1671, 1672. 1673. and 1674. 
[0084] As described above, on the DVD-RAM 
(DVD_RTR) disc, each V_PCK (video pack) is recorded 
in units of sectors each having a recording size of 2,034 35 
bytes (see FIG 3F) [one sector size is 2.048 bytes, but 
since $ach pack has a 14-byte pack header, the record- 
ing size per pack is 2,034 bytes]. 
[0085] When the l-picture size corresponding to one 
still picture information is smaller than an integer multi- 40 
pie of 2,034 bytes, dummy information 1704 is recorded 
in that short field. In this way, each l-picture can just fall 
within an integral number of sectors. 
[0086] Since l-picture size 1808 in each VOBU is 
recorded in information of a VOBU map for picture 45 
objects, as shown in FIG. 13 (to be described in detail 
later), the start position of dummy information 1704 in 
V_PCK (video pack) 1670 can be determined. Hence, 
the contents of dummy information 1704 can be arbi- 
trarily set so 
[0087] For example, as the contents of dummy infor- 
mation 1704, for example, a sequence end code (or a 
packet header with stream ID = 0 x be) can be 
recorded as specific information which can be specified 
as dummy when it is played back, in addition to padding 55 
data with all TTs or all Ts. 

[0088] Note that allocation of l-pictures is omitted in 
FIGS. 10F and 10L. but the data has the same structure 



as in FIGS. 10Cand10l. 

[0089] For example, when a still picture is sensed 
using a digital camera, and some comment is to be 
directly added by handwriting on that sensed picture 
(still picture), the information of the comment contents 
can be recorded as a sub-picture stream in SP_PCKs 
(sub-picture packs) 1681 , 1682, and 1683 in addition to 
the still picture recorded as l-picture in V__PCK. Upon 
playback, l-picture still picture information in V_PCK 
and sub-picture information in SP_PCKs are displayed 
to overlap each other 

[0090] Audio information that stores a comment for 
each stfll picture as audio data is recorded in A_PCKs 
(audio packs) 1691 to 1702. 

[0031] In this manner, V_PCKs 1661 to 1674. 
SP_PCKs 1681 to 1684. and A_PCKs 1691 to 1702 are 
gathered in units of associated still pictures, and are 
grouped in units of VOBUs (video objects for picture 
objects) 1641 to 1650. Hence, in the format shown in 
FIGS. 10A to 10L, each still picture forms one VOBU. 
[0092] In the embodiment shown in FIGS. 1 0A to 1 0L. 
V_PCKs and SP_PCK are recorded before A_PCKs in 
each VOBU. As a result the individual packs are sepa- 
rated in each VOBU. and information in each pack can 
be easily managed. 

[0093] However, the embodiment of the present inven- 
tion is not limited to the aforementioned limitation, and 
allows to allocate A_PCKs, V_PCKs. and SP_PCKs in 
an arbitrary order as in the recording format in video 
objects 1012. 

[0094] Furthermore. V_PCKs 1 664 having still picture 
information recorded in the l-picture format must be 
allocated in single VOBU 1642. but A_PCK (1694) that 
records part of audio information associated with VOBU 
1642 can be allocated in next VOBU 1643. 
[0095] As will be described later with reference to FIG. 
13. continuous audio information can be separated in 
correspondence with each still image using information 
of E_PTM (presentation terminating time) 1 81 4 of audio 
information recorded in VOBU map 1738 for picture 
objects. 

[0096] As the format that can continuously record a 
plurality of pieces of stfll picture information, the format 
structure shown in FIGS. 10A to 10L permits the follow- 
ing two different methods and mixed recording by both 
the methods. 

1) One VOB is formed of a plurality of VOBUs. 

2) One VOB has only one VOBU. and VOBs each of 
which records a single still picture are grouped to 
construct VTT (video title). 

[0097] FIGS. 10D to 10L show the former format 
structure 1). and FIGS. 10A to 10C show the latter for- 
mat structure 2). In the former format structure 1). FIGS. 
10D to 10F show the basic structure. As special exam- 
ples. FIGS. 10G to 101 show a structure which does not 
include any audio information (A_PCK), and FIGS. 10J 
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to 1 0L show a structure which does not include any orig- 
inal still picture (V_PCK). After a plurality of pieces of 
still picture information which do not contain any audio 
information and are sensed by a digital camera are 
recorded on the information storage medium (optical 
disc 1001) at one time, the user may often input memo 
data (additionally recorded as SP_PCK) or audio data 
(additionally recorded as A_PCK) for each still picture 
while observing the plurality of pieces of recorded still 
picture information. In such case, efficient editing and 
recording can be done when only additional data 
(memo and audio data) are gathered to form and record 
a VOB different from that which records original still pic- 
ture information, on the information storage medium 
(optical disc 1001). When additional data are recorded 
as another VOB, the contents of a VOB that records 
original still picture information need not be changed. In 
this fashion, the recording format in VOB 1634 that 
gathers only additional data (memo and audio data) for 
the purpose of easy editing for still picture information 
has a structure (which contains only A_PCK and 
SP_PCK without any V_PCK) similar to that shown in 
FIGS. 10Jto10L 

[0098] Note that I -picture data shown in FIGS. 10G 
and 101 corresponds to that shown in FIG. 3J. and 
dummy data shown in FIGS. 10C and 101 corresponds 
to dummy pack DM_PCK shown in FIG. 3F. 
[0099] Also, video pack V_PCK, sub-picture pack 
SP_PCK. and audio pack A_PCK shown in FIGS. 10A 
to 10L respectively correspond to V_PCK, SP_PCK, 
and A„PCK shown in FIG. 3F. 

[0100] Dummy pack DM_PCK shown in FIG. 3F or 
FIGS. 10C and 101 can be appropriately used for the 
purpose of audio data after recording and the like. For 
example, when the size of an encoded l-picture data 
cluster does not match an integer multiple of the block 
size (16 sectors/32 kbytes) of an error correction code 
(ECC) ftiat uses a product code. DM_PCK can be 
added to mis data cluster as needed so that the l-picture 
data dust©- size matches an integer multiple of 32 
kbytes. 

[0101] When the duster sizes of all l-picture data that 
form still pictures are matched with an ECC block unit 
(an integer multiple of 32 kbytes) by adding DM_PCK 
the following merits are obtained. 
[0102] For example, when one of a plurality of stilt pic- 
tures that have been continuously recorded on the 
medium shown in FIG. 1 is replaced by another still pic- 
ture (or erased), since the still picture (l-picture) to be 
replaced (or erased) has an ECC block urdt even if it has 
a size different from the original still picture, the ECC 
block units of l-pictures which are not replaced (not 
erased) are not rJsturbed 

[0103] For this reason, even when one of still pictures 
is replaced by another still picture (or erased). ECC cod- 
ing of l-pictures which are not replaced (not erased) 
need not be redone. Since ECC coding need not be 
redone, the operation speed of an RTR recorder can be 



improved accordingly, and recorded still pictures can be 
smoothly edited (to replace or ease some still pictures). 
[0104] However, when the size of a still picture to be 
replaced is larger than the original still picture size, the 

5 still picture data to be replaced is partially recorded at 
another recording location. That is, the replaced still pic- 
ture gets fragmented. When the seek speed of a disc 
drive that reads out data from the medium shown in 
FIG. 1 is tow, playback of the fragmented still picture 

10 requires a relatively long period of time. Hence, when 
an RTR recorder having no high-speed drive is used in 
playing back still pictures, the recorded data are prefer- 
ably arranged (to be re-recorded to remove fragmenta- 
tion) as needed. 

is [01 05] When the latter format 1 ) shown in FIGS. 1 0A 
to 10C is adopted as the format that allows to continu- 
ously record a plurality of pieces of still picture informa- 
tion, a plurality of VOBs are grouped, as shown in FIG. 
3C, to belong to different groups of VTTs (video titles) 

20 1407 and 1408. 

[0106] The recording format shown in FIGS. 10A to 
10L can record at least two still pictures at neighboring 
locations on the information storage medium (optical 
disc 1001). and can continuously record a plurality of 

25 still pictures in general. For this reason, for example, 
when a plurality of still pictures sensed by a digital cam- 
era are recorded on the information storage medium 
(optical disc 1001) at one time, a practical effect and 
feature can be obtained. La. quick recording can be 

30 attained. 

[0107] In addition, the recording format that can 
record a plurality of still pictures in a VOB has the follow- 
ing practical effects. 

[01 08] In the conventional recording format for a plu- 

35 raftty of still pictures sensed by a digital camera, stifl pic- 
tures are divisionally recorded one by one in different 
data files. When still pictures are divisionally recorded in 
different files, neither image seising order information 
among still pictures nor grouping information among still 

40 pictures are available. By contrast a negative fim (or a 
positive film prepared as needed) is available in case of 
a photographic fflm. For this reason, when a specific still 
picture is to be designated upon making an additional 
print, a still picture to be printed can be found by a 

45 search on the negative film in the photographing order. 
[01 09] In an information recording/playback apparatus 
(video recorder) for recording video information shown 
in FIG. 19. information of video object 1632 for picture 
objects recorded on the information storage medium 

so (optical disc 1001) is read, and still pictures can be dis- 
played on the screen in the allocation order of VOBUs 
1642 to 1644 like a positive film shown in FIG. 1 1. For 
example, a still picture at the left end in FIG. 11 
expresses information of VOBU 1642. and the central 

55 still picture expresses information of VOBU 1643. The 
still pictures shown in FIG. 11 can be moved to the right 
or left on the screen, and the user designates a stifl pic- 
ture to be edited (or to be hard-copied) Unlike video 
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objects 1012, still picture information designates an 
individual still picture using the display shown in FIG. 
1 1. (In video objects 1012, the video information range 
to be edited is designated by the display or presentation 
time.) 5 

[0110] The data structure in video object information 
that pertains to stffl picture information will be explained 
below. Video object information (or AVFIT) shown in 
FK3L 1F is divided into a management information field 
(M_AVFfT m FIG. 8) that pertains to general video infor- 10 
mation. and a management information field (S_AVFlT 
in FIGL 8) that pertains to still picture information. FIG. 
12 shows the data structure in the latter management 
information field (S_AVFiT) that pertains to still picture 
information. 75 
[0111] The still picture AV file information table 
(S_AVFfT) contained in navigation data RTR_VMG 
shown in FIG. 8 contains still picture AV file information 
table information (S_AVFITI), still picture VOB stream 
information (S_VOB_STI#1 to S_VOB_STI#n), still pic- 20 
ture AV file information (S_AVFI). still picture additional 
audio stream information (S_AA_STI#1 to 
S_AA__STI#m), and still picture additional audio file 
information (S_AAFI), as shown in the left column in 
FIG. 12. 25 
[01 12] The still picture AV file information (S_AVFI) 
contains VOB information (or S_AVF1 general informa- 
tion S_AVFI_GI) 1721 for picture objects management 
information, search pointer #1 (or still VOB group infor- 
mation search pointer S_VOGL_SRP#1) 1726 of VOB 30 
information for picture objects,.... #i (S_VOGI_SRP#i) 
1727 #k (S_VOGI_SRP#k) 1728. and VOB informa- 
tion #1 (or still picture VOB group information 
S_VOGI#1) 1731 for picture objects..... # (S_VOGI#i) 

1732 #k (S_VOGI#k) 1733. as shown in the central 35 

column in FIG. 12. 

[01 1 3] VOB information #i for picture objects (or still 
picture VOB group information S_VOGI#i) has the con- 
tents shown in the right column in FIG. 12 (the same 
applies to VOB information #1 and information #k for 40 
picture objects). 

[0114] That is. VOB information #i for picture objects 
is comprised of VOB general information 1736 for pic- 
ture objects (or stfll picture VOB group general informa- 
tion S_VOG_GI), VOB attribute information 1737 for 45 
picture objects, and VOBU map 1 738 few picture objects 
(or one or more still picture VOB entries S_VOB_ENT#). 
[0115] Note that S_VOG_GI contains the number 
(S_VOB_Ns) of VOBs. a still picture VOB stream infor- 
mation number (S_VOB_STIN). time information so 
(FIRST_VOB_REC_TM) indicating the recording time 
of the first VOB in that VOB group, time information 
(LAST_VOB_REC_TM) indicating the recording time of 
the last VOB in that VOB group, and the start address 
(S_VOG_SA) of the VOB group in a still picture AV file. 55 
S_VOG_SA expresses a relative address from the first 
address of S_AVFI in units of sectors. 
[0116] On the other hand, S_VOB_ENT# includes four 



types (types 1 to 4). which respectively have the follow- 
ing contents: 

(1) S_VOB_EfviT of type 1 contains information 
(S_VOB_ENT_TY) indicating the type of VOB entry 
of a still picture, and information (V_PART_SZ) indi- 
cating the video part size in a still picture VOB in 
units of sectors. 

(2) S_VOB_Er\TT of type 2 contains information 
(A_PART_SZ) that expresses the original audio 
part size in a still picture VOB in units of sectors, 
and information (A PB TM) that expresses the 
playback time of this audio part in units of video 
fields, in addition to S_VOB_ENT_TY and 
V_PART_SZ of type 1. When the playback time of 
an actual audio part does not match a boundary of 
video fields, data after the video field of end data of 
the audio part is discarded. 

(3) S_VOB_ENT of type 3 contains number infor- 
mation (S_AAGN) of an additional audio group con- 
tained in an audio stream added to a still picture 
VOB. and information (AAENTN) of an entry 
number corresponding to this sill picture VOB addi- 
tional aucfio stream, in addition to S_VOB_ENT_TY 
and V_PART_SZ of type 1. 

(4) S_VOB_ENT of type 4 contains S_AAGN and 
AA_ENTN of type 3 in addition to S_VOB_ENT_TY. 
VPART.SZ. A_PART_SZ, and A_PB_TM of type 
2. 

[01 1 7] S_VOB_ENT of each of types 1 to 4 commonly 
contains S_VOB_ENT_TY and V_PART_SZ of type 1 . 
[01 18] Note that each S_AA_ST! (#1 to #m) in the left 
column in FIG. 1 2 contains audio attribute information of 
an additional audio stream. From this viewpoint. 
S_AA_STI corresponds to VOB attribute information 
1 737 in the right column of FIG: 12. 
[01 1 9] A plurality of pieces of still picture information 
grouped to different video objects for picture objects 
(VOBs for picture objects) are recorded in video object 
information 1 73 1 for picture objects to video object infor- 
mation 1733 for picture objects (or S_VOGI#1 to 
S_VOGI#k) in FIG. 12. 

[01 20] The information contents shown in the right col- 
umn in FK3. 12 will be briefly explained below. 
[0121] Information 1732 contains the following infor- 
mation: 

*VOB general information 1 736 for picture objects (or 
S_VOG_GI) ... 

[0122] 

* ID information uniquely set in units of VOBs so as 
to designate a specific VOB in. e.g.. cell playback 
information (CI in FIG. 1F or S_CI in FIG. 23) 1108; 

•VOB type information ... information indicating 
information shown in FIGS. 10A to 10L to which the 
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VOB belongs, information indicating video informa- 
tion (video objects 1012)/stifl picture information 
(picture objects 1013)/audio information (audio 
objects 1014) to which the VOB pertains, and the 
date of recording of the VOB on the information 
storage medium (optical disc 1001); 

*VOB attribute information 1 737 for picture objects ... 
[0123] 

• attribute information such as resolution or the like 
of still picture and/or attribute information of audio 
information, 

• the number of pieces of sub-picture information, 
recording format and the like; *VOB map 1738 for 

. picture objects 

... information that pertains to all still pictures 
. included in a VOB. 

[0124] Video object information 1721 for picture 
objects management information contains the following 
information: 

• the number of VOBs for picture objects contained 
in this AV file. 

•general information that pertains to VOBs con- 
tamed in this AV file: and the like. 

[0125] Also, address data indicating the recording 
locations of a plurality of pieces of video object informa- 
tion 1731 to 1733 for picture objects in video object 
information 1107 shown in FIG. 1F are recorded in 
search pointers 1726 to 1728 of video object informa- 
tion for picture objects. 

[0126] The data structure in VOBU map 1 738 for pic- 
ture objects will be explained below with reference to 
FK3L13. 

[0127] As shown in the central column of FIG. 1 3, the 
number of still pictures contained in the corresponding 
VOB (i.e., the number of VOBUs; or number of such 
VOBs S_VOB_Ns) 1801 is stored at the beginning of 
VOBU map 1738 for picture objects (S_VOB_ENT#). 
Information (1802, 1803. 1804,..) that pertains to each 
still picture (contents of a VOBU) follows in the alloca- 
tion order in a VOB. 

[0128] As the information (e.g., 1803) that pertains to 
each still picture (contents of a VOBU). information 
shown in the right column in FIG. 13 is recorded. 
[0129] Referring to FIG. 13. information 1807 of VOBU 
141 1 (FIG. 3E) having one still picture information which 
also contains audio information is divisionally recorded 
on a plurality of sectors 1 431 to 1434. as shown in. e.g.. 
FIG. 3F. Data size (V_PART_SZ and/or A_PART_SZ) 
1 806 far one still picture information (VOBU) is indicated 
by the number of sectors used in divisional recording. 
[0130] In case of a VOBU which includes A_PCK 
(audio pack), as shown in FIGS. 10A to 10C or FIGS. 



10D to 10F. display time 1807 of one still picture means 
the playback time of audio information in a VOBU. On 
the other hand, in case of a VOBU which includes no 
A_PCK (audio pack), as shown in FK3S. 10G to 101. dis- 
5 play time 1807 means the still display period of a still 
image. 

[01 31 ] As information that pertains to still image infor- 
mation itseff in a VOBU that records one still picture 
information, the following information (the right column 
10 in FIG. 13) is recorded. 

-start V_PCK address (or S_VOG_SA) 1808 in the cor- 
responding VOBU 

is [0132] ... Taking FIGS. 10A to 10L as an example, 
address data of V_PCKs 1661. 1664. 1665, 1666, 1667. 
1668. 1671. 1674. and the like located at the start posi- 
tions of VOBUs are recorded. When the ID of a VOB 
that contains a still image the user wants to watch, and 

20 the still picture number (VOBU number) in that VOB are 
designated, an optical head (not shown) directly 
accesses the start V_PCK address of the correspond- 
ing VOBU using this address data. 
[0133] In general, as address information, the LAN 

25 (logical sector number) directly indicating the position 
on the information storage medium (optical disc 1001) is 
used, as shown in FIG. 4. However, the present inven- 
tion is not limited to such specific address indication 
method, and other application examples are available. 

30 For example, as shown in FIG. 9C, the address on the 
medium may be indicated by the number of sectors (rel- 
ative address) by counting sectors in the sequence 
order from the first address of a given VOB in accord- 
ance with the sequence order of data. 

*l -picture size 1809 in corresponding VOBU 

[01 34] ... As has been described above with reference 
to FIG. 10C or FIG. 101, dummy information 1704 is 

40 recorded in a field which is short from an integer multi- 
ple of 2,034 bytes as the pack size in the data sizes of I- 
pictures 1706 and 1707. Hence, when the l-picture size 
is known in advance, the recording location of dummy 
information 1 704 can be detected, and the next location 

45 can be accessed without playing back that location, 
thereby realizing high-speed playback *S_PTM (pres- 
entation starting time) 1810 of still picture (V_PCK & 
SP_PCK) 

[01 35] ... This information indicates the display timing 
so of a stin picture and a sub-picture added thereto upon 
playback. In this embocfimerrt, a still picture recorded in 
V_PCK and a sub-picture to be added to that picture are 
simultaneously displayed upon playback. S_PTM is 
used to set the display timing in relation to audio infor- 
55 mation in one VOBU. 
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*Rrst_SCR (first system dock) 181 1 of still picture 
(V_PCK) 

[0136] ... This information means the system dock 
value upon creating first V_PCK in a VOBU upon 5 
recording on the information storage medium (optical 
disc 1001 ). and is used upon executing seamless (con- 
tinuous) playback. 

101 37] As information that pertains to audio informa- 
tion in a VOBU which records one still picture informa- 10 
tion, the following information is recorded, first A_PCK 
address 1812 in VOBU 

[0138] ... Taking FIGS. 10A to 10L as an example, 
address data of, e.g.. A_PCKs 1691, 1693. 1694, 1695, 
1 696. 1 699. 1 702, and the like located at the start posi- 15 
tions of VOBUs are recorded. When the ID of a VOB 
that contains a stfll image the user wants to watch, and 
the still picture number (VOBU number) in that VOB are 
designated, an optica] head (not shown) directly 
accesses the start V_PCK address of the correspond- 20 
ing VOBU using this address data. 
[01 39] As shown in FIG. 14C, in the present invention, 
audio information (A_PCK information) in one VOB can 
be displayed in combination with still picture information 
that belongs to another VOB. Hence, this information is 25 
used when audio information alone in a VOB is selec- 
tively played back. 

*S_PTM (presentation starting time) 1813 of audio infor- 
mation (A_PCK) 30 

[0140] ... This information indicates the output timing 
of audio information upon playback. In most cases, this 
value matches S_PTM 1810 of a still picture (V_PCK & 
SP_PCK). A different value may be intentionally set 35 
when an audio is to be output a specific time (e.g., 0.5 
sec) after a still picture is displayed on the screen. In this 
manner, this information is used in timing control 
between the still picture display and audio information 
output 40 

*E_PTM (presentation terminating time) 1814 of audio 
information (A_PCK) 

[0141] ... This information indicates the output termi- 45 
nation timing of audio information upon playback, and is 
used in timing control between the still picture display 
and audio information output In most cases, this value 
matches S_PTM 1810 (to be descrfoed below) of a still 
picture (V_PCK & SP_PCK). A different value may be so 
intentionally set when the next still picture information 
begins to be displayed a specific time (e.g., 0.5 sec) 
after termination of the audio output *Rrst_SCR (first 
system clock reference) 1815 of audio information 
(A_PCK) 55 
[0142] ... This information indicates the system clock 
value upon creating first A_PCK in a VOB upon record- 
ing on the information storage medium (optical disc 



1001). and is used upon executing seamless (continu- 
ous) playback 

*Last__SCR (last system dock reference) 1816 of audio 
information (A_PCK) 

[0143] ... This information indicates the system clock 
value upon creating last A__PCK in a VOB upon record- 
ing on the information storage medium (optical disc 
1001). and is used upon executing seamless (continu- 
ous) playback. 

[01 44] The contents corresponding to A PB TM men- 
tioned in the description of S__VOB_ENT in FIG. 12 can 
be expressed by a pair of First_SCR and Last_SCR 
above. 

[0145] In this manner, by recording presentation time 
PTM information and system dock reference SCR infor- 
mation that respectively pertain to still picture informa- 
tion and audio information, video information that 
belongs to video objects 1012 shown in FIG. 1D can be 
used as a part of still picture information. 
[01 46] More specifically, new video object information 
for picture objects (S_VOB) for a still picture is defined 
as follows without modifying video information "itself that 
belongs to video objects 1012. 

[01 47] A case will be explained below wherein still pic- 
tures that change every 2 sec are defined with respect 
to the conventional video method (video objects 1012). 
fn general, since the time required for one GOP in video 
information is 0.5 sec. one VOBU shown in FJGL 3E nor- 
mally has a duration around 0.5 sec. Since 2 sec -3- 0.5 
sec = 4. the first 1 -pictures of every four VOBUs are con- 
sidered as still pictures, thus setting information of first 
V_PCK address 1 808 and I -picture size 1 809 in a VOB. 
and setting the numerical values of data in the right col- 
umn of FIG. 18. 

[0148] As a result by combining and displaying still 
picture information and audio information that belong to 
different VOBs (VOB#A and VOB#B). as shown in 
FIGS. 14A to 14G. only an audio part in video informa- 
tion that belongs to video objects 1012 can be output 
upon displaying a still picture, or only a scene the user 
likes in video information that belongs to video objects 
1012 can be converted into a still picture and the still 
picture can be cfisplayed. 

[0149] A method of displaying a plurality of still pic- 
tures will be explained below. 

[0150] As a method of cfisplaying a plurality of pieces 
of still picture information recorded on the information 
storage medium (optical disc 1001), a method of simul- 
taneously displaying a plurality of pictures in a given lay- 
out (still pictures to be displayed in the given layout are 
often moved or replaced), as shown in FIG 11. and a 
method of displaying one still picture, and changing the 
still picture to be displayed at specific time intervals are 
available. In either method, a cell and PGC information 
are used in the data structure, as shown in FIGS. 6 and 
7. and tie user can choose the display method by an 
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information recording/playback apparatus <RTR video 
recorder) for recording video information shown in FIG. 
19. 

[0151] As in video object information 1 107. cell play- 
back information (or CI) 1108 shown in FIG. 1F is 
divided into cell playback information (M_CI) that per- 
tains to video information, and cell playback information 
(S_CI) that pertains to still picture information. The cell 
playback information (S_CI) that pertains to still picture 
information has a structure that can play back a still pic- 
ture and audio information from different locations, and 
can present them together, as shown in FIGS. 14A to 
14G. 

[0152] More specifically, as shown in FIGS. 14C to 
14E. in this structure. V_PCKs 1852 and 1854, and 
SP_PCK 1848 used in display in a given cell can desig- 
nate still pictures (STL PCT) 1832 and 1834 in VOB#A 
1821, and audio information output from that cell can 
designate audio information 1 845 and audio information 
1 846 in VOB#B 1822 different from VOB#A 1 821 . 
[01 53] This structure is suitable for after recording set- 
ups for a still picture. For example, when still picture 
information sensed by a digital camera having no audio 
input function is directly recorded on the information 
storage medium (optical disc 1001). its recording result 
has a structure that does not contain any A_PCK (audio 
pack), as shown in FIG. 101. A case wilt be examined 
below wherein the recorded information is played back, 
and comments are added to still pictures one by one by 
"audio input via a microphone", "overwriting marks by 
handwriting", "addition of text information by key-in", 
and the like, while displaying them on the screen, as 
shown in FIG. 1 1 . 

[01 54] In this case, when the recording format is to be 
changed from the structure that does not contain any 
A_PCK shown in FIG. 101 to a structure that contains 
A_PCK shown in FIG. 10F, re-recording must be done 
on the information storage medium (optical disc 1001), 
resulting in cumbersome processes and a long process- 
ing time. 

[0155] By contrast, when additional information alone 
is recorded as another VOB 1634 on the information 
storage medium (optical disc 1001), as shown in FIGS. 
10J to 10L, without modifying the data that does not 
contain any A_PCK (audio pack) shown in FIG. 101, 
information can be added to a still image very easily and 
quickly later. Upon display, VOBs 1633 and 1634 in 
FIGS. 10G and 10J are displayed and output together 
like VOBs 1403 to 1405 in FIG. 3D. 
[0156] FIG. 15 shows the data structure in cell play- 
back information for picture objects (S_CI) that allows 
the presentation shown in FIGS. 14A to 14G. ID infor- 
mation (or CI_SRP) 1873 as an identifier unique to a 
cell is described first Type information (or C_TY) 1880 
of a cell described next represents . 

1) identification information for identifying cell infor- 
mation that pertains to video information (video 



objects 1012), cell information that pertains to a still 
picture (picture objects 1013), or cell information 
that pertains to only audio information (audio 
objects 1014); and 

5 2) identification information for identifying cell infor- 

mation (corresponding to the structure shown in 
FIG. 1 5) for a VOB that records a plurality of still pic- 
tures (the format shown in FIGS. 10D to 10L), or 
cell information (corresponding to the structure 

w shown in FIG. 16) for a VOB that records only one 
still picture (the format shown in FIGS. lOAto 10C). 

101 57] In this way. by absorbing any differences of the 
recording formats that record still pictures at the level of 

15 cell playback information for picture objects (S_CI). both 
still and moving pictures can be played back and dis- 
played in a single sequence at the level of PGC shown 
in FIG. 7 beyond the recording format difference of 
VOBs, irrespective of the still picture information and 

20 moving picture information. 

[01 58] In the embodiment shown in FIG. 1 4A, VOB#A 
1821 is designated as ID information 1874 of a VOB 
shown in FIG. 15 that records a video pack. When the 
user wants to display stilt pictures from the second one 

25 in VOB#A 1821 . still picture number 2 in VOB#A 1821 is 
designated as still picture number 1875 to be displayed 
first in a cell. Also, in correspondence with the embodi- 
ment shown in FIG. 14B, still picture number h in 
VOB#A 1821 is designated as still picture number 1876 

30 to be displayed last in the ceO. 

[01 59] In this manner, the cell playback information for 
picture objects (S_CI) directly designates a "still picture" 
itself. 

[0160] In the embodiment show in FIG. 15, "still pic- 

35 ture number" is designated as a method of designating 
a still picture. However, the present invention is not lim- 
ited to such specific method. For example, a still picture 
may be designated by "designating a unit (e.g., a 
VOBU) itself where a still picture is recorded", "desig- 

40 nating the start address of a location where a still pic- 
ture is recorded", "designating the sequence order in a 
VOB", and the like. In FIG. 15, the first and last still pic- 
tures in the cell are designated. However, in place of the 
above display method, the first still picture to be dis- 

45 played in a cell, and the total number of still pictures to 
be displayed in that cell may be designated. 
[0161] Similarly, in FIG. 15. ID information 1877 
(which designates VOB#B 1822 in the embodiment 
shown in FIG. 14G) of a VOB that records an audio 

so pack, and stiD picture number 1878 (which designates 
still picture number j in the embodiment shown in FIG. 
14F) indicating the recording destination of the first 
audio i n formation (A_PCK) to be output in a cell are 
described. 

55 [0162] In FIG. 15, no still picture number information 
indicating the recording destination of the last audio 
information (A_PCK) to be output in the cell is 
described. However, since ttte total number of still pic- 
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tures to be displayed in one cell can be detected based 
on still picture number 1875 that indicates the first still 
picture to be displayed in a cell, and still picture number 

1 876 indicating the last still picture to be displayed in the 
cell, that still picture number information need not be 5 
described. 

[0163] When audio information is designated for all 
still pictures in FIG. 14C. the presentation time per still 
picture can be determined by S_PTM 1813 and E_PTM 
1814 of audio information shown in FIG. 13. On the io 
other hand, when no audio information is designated for 
a specific VOBU, the still picture presentation time is set 
using information of presentation time 1879 per still pic- 
ture. 

[01 64] Referring to FIG. 1 5, 1873 to 1876 correspond is 
to the still picture file (RTR_STO.VRO) in FIG. 2, and 

1 877 to 1 879 correspond to the after recording audio file 
(RTR_STA.VRO) shown in FIG. 2. 

[0165] A grouping and displaying method when one 
VOB records only one still picture will be explained 20 
below. 

[01 66] As shown in FIGS. 1 0A to 1 0C. when one VOB 
(video object for picture objects) 1631 records only one 
still picture, a plurality of VOBs having still pictures are 
grouped and that group is handled as part_of JStle. This 25 
grouping information is recorded in part_of_trties infor- 
mation 1753 (FIG. 8) in video title set information 
(RTR_VMGI) 1106 shown in FIG. 1F. 
[0167] The data structures in part_of__titles informa- 
tion 1 753 that pertains to still pictures shown in FIG. 1 7, 30 
and VOB map 1899 for picture objects are similar to 
those in video object information (S_VOGI#) shown in 
FIG. 12, and the VOBU map for picture objects 
(S_VOB_ENT#) shown in FIG: 13. 

[0168] Also, the structure of the corresponding cell 35 
playback information for picture objects (CI) shown in 
FIG. 16 is similar to that erf S_CI shown in FIG. 1 5. 
[0169] One embodiment of an information recording/ 
playback apparatus (RTR video recorder) for recording 
video information will be explained below. 40 
[0170] FIG. 19 is a block diagram for explaining the 
arrangement in the RTR video recorder. In this specifi- 
cation, reference numerals are indicated within blocks 
to save space. 

[0171] The apparatus main body of the video recorder 45 
shown in FIG. 19 is roughly comprised of disc changer 
(disc drive unit) 1500 for rotating one to be used of one 
or a plurality of information storage media (optical rises) 
1001, and executing recording and playback of video 
information with respect to optical <fisc 1001, encoder so 
unit 1550 that constructs the video recording side, 
decoder unit 1560 that constructs the playback side, 
and system controller (MPU) 1530 which incorporates a 
ROM and RAM (semiconductor memory), and controls 
the operations of the apparatus main body. 55 
[01 72] Encoder unit 1 550 comprises ADC (analog-to- 
digital converter) 1552. video encoder (V encoder) 
1553. audio encoder (A encoder 1554). sub-picture 



encoder (SP encoder) 1555. formatter 1556. and buffer 
memory 1557. 

[0173] ADC 1552 receives an external analog video 
signal + external analog audio signal from AV input 
1542. or analog TV signal + analog audio signal from 
TV tuner 1544. This ADC 1552 converts the input ana- 
log video signal into digital data at. eg., a sampling fre- 
quency = 13.5 MHz and the number of quantization bits 
= 8. (More specifically, luminance component Y. color 
difference component Cr (or Y-R), and color difference 
component Cb (or Y-B) are respectively quantized by 8 
bits.) 

[01 74] Likewise. ADC 1 552 converts the input analog 
audio signal into digital data at e.g.. a sampling fre- 
quency = 48 kHz and the number erf quantization bits = 
16. 

[0175] When an analog video signal and digital audio 
signal are input to ADC 1552. the digital aucfio signal 
passes through ADC 1 552. (A process for reducing jitter 
superposed on a digital signal, a process for changing 
the sampling rate and the number of quantization bits, 
or the Oke without changing the contents of a digital 
audio signal may be done.) 

[0176] When a digital video signal and digital audio 
signal are input to ADC 1552, these signals pass 
through ADC 1552 (for these digital signals, a jitter 
reduction process, sampling rate change process, or 
the like that do not change their contents may be done). 
[01 77] When still picture information sensed by digital 
camera 1543 is input in addition to the input video sig- 
nals, it is cfirectly input to V encoder 1553 without the 
intervention of ADC 1552. 

[0178] A digital video signal component output from 
ADC 1552 is sent to formatter 1556 via video encoder 
(V encoder) 1553. A digital aucfio signal component out- 
put from ADC 1552 is sent to formatter 1556 via audio 
encoder (A encoder) 1554. Or a still picture signal 
directly input to V encoder 1553 is sent from V encoder 
1553 to formatter 1556. 

[0179] V encoder 1553 has a function of converting 
the input digital video signal into a digital signal corn- 
pressed at variable bit rate on the basis of the MPEG2 
or MPEG1 specifications. 

[0180] In digital camera 1 543. still picture information 
is recorded in the bitmap or JPEG format By contrast, 
in the present invention, a still picture is recorded on 
optical disc 1001 in the l-picture format of MPEG2. For 
this purpose, in the present invention, V encoder 1553 
has format conversion functions of "bitmap -> MPEG2". 
"JPEG -* MPEG2". and the Ifce. 
[0181] A encoder 1554 has a function of converting 
the input digital audio signal into a digital signal (or lin- 
ear PCM cfigital signal) compressed at fixed bit rate on 
the basis of the MPEG or AC-3 specifications. 
[0182] When a digital video signal (for example, a sig- 
nal from a DVD video player with an independent output 
terminal of a sub-picture signal) is input from AV input 
1542. or when a DVD video signal with such data struc- 
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ture is broadcasted and is received by TV tuner 1544, 
the sub-picture signal component (sub-picture pack) in 
the video signal is input to sub-picture encoder (SP 
encoder) 1555. Sub-picture data input to SP encoder 
1555 is arranged into a predetermined signal format, 
and is then sent to formatter 1556. 
[01 83] Formatter 1 556 executes predetermined signal 
processing of the input video signal, audio signal, sub- 
picture signal, and the like using buffer memory 1557 as 
a work area, and outputs recording data that matches a 
predetermined format (file structure) to data processor 
1536. 

[0184] In case of digital broadcast a video signal is 
transmitted in the TS (transport stream) format of 
MPEG2. In general, when a video signal is recorded on 
information storage medium (optical disc) 1001 in the 
MI?EG2 format, the PS (program stream) format is 
used. Hence, upon receiving digital broadcast, the 
received signal is directly sent from TV tuner 1 544 to 
formatter 1556. which executes "TS -> PS conversion". 
[0185] Standard encode process contents for creating 
the recording data will be briefly explained below. More 
specifically, when encoder unit 1550 shown in FIG. 19 
starts an encode process, parameters required for 
encoding video (main picture) data and audio data are 
set Main picture data is pre-encoded using the set 
parameters, and optimal code amount distribution for 
the selected average transfer rate (recording rate) is cal- 
culated. Then, the main picture data is encoded based 
on the code amount distribution obtained by pre-encod- 
ing. At this time, aucfio data is encoded simultaneously. 
[0186] As a result of pre-encoding. if it is determined 
that the data compression amount is insufficient (a 
desired video program cannot fall within information 
storage medium (optical disc) 1001 to be used), and 
pre-encoding can be re-done (if the source to be 
recorded is a source that can be repetitively played back 
such as a video tape, video disc, or the like), main pic- 
ture data is partially re- encoded, and the previously pre- 
encoded main picture data portion is replaced by the re- 
encoded main picture data portion. With a series of 
processes described above, the main picture and audio 
data are encoded, and the average bit rate value 
required for recording can be greatly reduced. 
[0187] Likewise, parameters required for encoding 
sub-picture data are set and encoded sub-picture data 
is generated. 

[0188] The encoded main picture, audio, and sub-pic- 
ture data are combined, and are converted into the data 
structure of desired video objects. 
[0189] More specifically, a cell as a minimum unit of 
main picture data (video data) is set the configuration of 
cells that form a program chain, attributes of the main 
picture, sub-picture, and audio data, ami the like are set 
(some of such attribute data use information obtained 
upon encoding the respective data), and management 
information that contains various kinds of information 
which pertain to cells is recorded in the management 



information recording area (control information 1011 in 
FIG. 10 or RTR.1FO in FIG. 2). 

[01 90] The encoded main picture, audio, and sub-pic- 
ture data are segmented into packs each having a pre- 

5 determined size (2,046 bytes). Dummy packs that can 
be used in. e.g., after recording, are inserted into these 
packs as needed. Note that time stamps such as PTS 
(presentation time stamp), DTS (decode time stamp), 
and the like are described in packs other than dummy 

10 packs, as needed. As for PTS of sub-picture data, a 
time arbitrarily delayed from PTS of main picture data or 
audio data in the identical playback time band can be 
descrfoed. 

[0191] Data cells are arranged in units of VOBUs to 

is allow playback in the time code order of data, thus form- 
ing a VOB consisting of a plurality of cells. 
[0192] Upon digitally copying video information from 
the digital output of the RTR video recorder shown in 
FIG. 19, since the contents of the cells, program chains, 

20 management tables, time stamps, and the like are 
determined in advance, they need not be created again. 
[01 93] The arrangement for reading/writing (recording 
and/or playing back) information from/to optical disc 
1001 comprises disc drive unit (disc changer) 1500, 

25 information recording/reproducing unit 101. temporary 
buffer memory 1534. data processor 1536. and system 
time counter (or system time clock: STC) 1538. 
[0194] Temporary buffer memory 1534 is used to 
buffer a given amount of data to be written on optical 

30 disc 1 001 (data output from encoder unit 1 550) via infor- 
mation recording/reproducing unit 101. and to buffer a 
given amount of data played back from optical disc 1001 
(data input to decoder unit 1560) via information record- 
ing/reproducing unit 101 . 

35 [0195] For example, when temporary buffer memory 
1534 comprises a 4-Mbyte semiconductor memory 
(DRAM), it can buffer recording or playback data for 
approximately 8 seconds at an average recording rate 
of 4 Mbps. When temporary buffer memory 1534 com- 

40 prises a 16-Mbyte EEPROM (flash memory), it can 
buffer recording or playback data for approximately 30 
seconds at an average recording rate of 4 Mbps. Fur- 
thermore, when temporary buffer memory 1534 com- 
prises a 1 00 -Mbyte, very small HDD (hard cfisc drive), it 

45 can buffer recording or playback data for 3 minutes or 
more at an average recording rate of 4 Mbps. 
[01 96] Also, temporary buffer memory 1 534 can also 
be used to temporarily store recording information when 
optical disc 1001 is used up during video recording, until 

so optical disc 1001 is exchanged by a new disc. 

[0197] When information recording/reproducing unit 
101 uses a high-speed recording/reproducing unit hav- 
ing a speed equal to or higher man double speeds, tem- 
porary buffer memory 1534 can also be used to store 

55 readout data exceeding a normal amount read out from 
the drive per unit time. When temporary buffer memory 
1 534 buffers readout data upon playback, even when an 
optical head (not shown) has caused read errors due to 
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vibration shock or the like, playback data buffered by 
temporary buffer memory 1534 can be used instead, 
thus preventing a playback image from being discontin- 
ued. 

[0198] If an external card slot (not shown in FIG. 19) 5 
is provided to the RTR video recorder, the EEPROM 
can be offered as an option IC card. On the other hand, 
if an external drive slot or SCSI interface is provided to 
the RTR video recorder, the HDD can be offered as an 
option extension drive. w 
[0199] When a personal computer is used as a DVD 
video recorder by software, the free area of a hard disc 
drive or main memory of the personal computer itself 
can be used as temporary buffer memory 1534 shown 
in FIG. 19. 15 
[0200] Under the control of system controller (MPU) 
[incorporating the ROM and RAM] 1 530. data processor 
1 536 shown in FIG. 1 9 performs: 

•supply of a video information signal to be 20 
recorded from encoder unit 1550 to information 
recorcBng/reproducing unit 101 ; 

•transfer of a video information signal played back 
by information recording/reproducing unit 101 to 
another unit; 25 

•rewrite of management information (control infor- 
mation 1011) recorded on information storage 
mecGum (optical disc) 1001; 

• partial deletion of video information and manage- 
ment information (control information 1011 or 30 
RTRJFO or RTR_VMG) as data recorded on infor- 
mation storage medium (optical disc) 1001 ; and the 
lite. 

[0201] System controller 1 530 includes an MPU (or 35 
CPU), a ROM as an IC memory written with control pro- 
grams and the like, and a RAM as an IC memory that 
provides a work area required for executing programs. 
[0202] Of the execution results of system controller 
1530. the contents the user of the RTR video recorder 40 
should know are displayed on display/input panel 1548 
of the RTR video recorder. 

[0203] Note that the control timings of disc changer 
1500. information recording/reproducing unit 101, data 
processor 1536, and encoder unit 1 550 and/or decoder 45 
unit 1560 by system controller (MPU) 1530 can be 
determined based on time data supplied from STC 
1538 (video recording/playback are normally executed 
in synchronism with time clocks from STC 1538. but 
other processes may be executed at timings independ- so 
entlyof STC 1538). 

[0204] Decoder unit 1560 comprises separator 1562 
for separating the respective packs from video informa- 
tion with the pack structure recorded on optical disc 
1001 , memory 1563 used upon executing pack separa- 55 
ton and other signal processes, video decoder (V 
decoder) 1564 for decoding main picture data (the con- 
tents of video packs) separated by separator 1562, sub- 



picture decoder (SP decoder) 1565 for decoding sub- 
picture data (the contents of sub-picture packs) sepa- 
rated by separator 1562, audio decoder (A decoder) 
1568 for decoding audio data (the contents of audio 
packs) separated by separator 1562, video processor 
1566 for appropriately mixing sub-picture data from SP 
decoder 1565 with video data output from V decoder 
1564. i.e., superposing sub-picture data such as 
menus, highlight buttons, superimposed dialogs, and 
the like on main picture data, and outputting them, video 
digital-to-analog converter (V • DAC) 1567 for convert- 
ing the digital video output from video processor 1565 
into an analog video signal, and audio digrtaMo-analog 
converter (A • DAC) 1 569 for convening the digital audio 
output from A decoder 1 568 into an analog audio signal. 
[0205] The analog video signal (analog video informa- 
tion signal) output from V • DAC 1567, and the analog 
audio signal output from A - DAC 1569 are supplied to 
an external component (not shown; a mufti-channel 
stereo system having two to six channels + monitor TV 
or projector) via AV output 1 546. 
[0206] OSD (On Screen Display) data output from 
system controller (MPU) 1530 is input to separator 1562 
in decoder unit 1 560, and is then input to video proces- 
sor 1566 via V decoder 1564 (not decoded). The OSD 
data is superimposed on main picture data, and they 
are supplied to an external monitor TV connected to AV 
output 1546. Thus, a warning message is displayed 
together with main picture data. 
[0207] The operations of the information recording/ 
playback apparatus (RTR video recorder) for recording 
video information shown in FIG. 19 will be described 
below with reference to the flow charts. 
[0208] The sequence for recording a plurality of still 
pictures on information storage medium (optical disc) 
1001 will be described below with reference to FIG. 20. 
[0209] Still picture files are continuously input from 
digital camera 1543 as data (ST1). 
[021 0] Since each still picture file received from digital 
camera 1543 is normally recorded in the JPEG or bit- 
map format the input still picture information is con- 
verted into I -picture data of MPEG2 at V encoder 1553 
(ST2). 

[021 1 ] Formatter 1 556 prepares the VOBU structure 
with the data structure shown in FIG. 3 with respect to 
single still picture information, and groups a plurality of 
still pictures to construct a VOB (ST3). 
[021 2] Parallel to the aforementioned processes, infor- 
mation recoixfing/reproductng unit 101 reproduces all 
pieces of control information 1011 (RTRJFO/ 
RTR VMG) recorded on optical disc 1001. and saves 
the reproduced contents in the internal RAM of system 
controller 1530 (ST4). 

[021 3] System controller 1530 obtains information of 
allocation map table 1 105 from the contents of control 
information 1011 saved in its internal RAM, and 
searches for the location of unrecorded area 1460 (FIG. 
4)(ST5). 
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[0214] After that, system controller 1 530 sends control reproducing unit 101 then accesses the information 

information to formatter 1556. data processor 1536. and recording position of VOB#A recorded on optical disc 

information recording/reproducing unit 101. and con- 1001 to reproduce still picture information in VOB#A 

trols information recording/reproducing unit 101 to (ST16). Finally, AV output 1546 simultaneously outputs 

record a VOB having a plurality of pieces of still picture 5 (displays) audio information in VOB#B and still picture 

information on unrecorded area 1 460 (ST6). information in VOB#A (ST1 7). 

[021 5] During recording, system controller 1 530 mon- [0225] As described above, the method of simuttane- 

itors the recording state, and checks if the VOB is sue- ously reproducing only audio information for a plurality 

cessfully recorded on optical disc 1001 (ST7). If trouble of still pictures or only still picture information, saving 

has occurred during recording, the processes in steps w the reproduction result in memory 1562, simultaneously 

ST4 to ST6 are repeated. reproducing the remaining information, and outputting 

[0216] If the VOB is successfully recorded on optical (displaying) the reproduction results at the same time is 

disci 001 . system controller 1 530 prepares VOBU map used. With this method, compared to a method of repro- 

1738 in FIGL 12 (or VOB map 1899 in FIG. 17) on the ducing still picture information and aucfio information in 

basis of address information recorded on optica) disc 15 units of still pictures, the frequency of access of the opti- 

1001 (ST9). Finally. VOBU map 1738 (or VOB map cal head can be greatly reduced, thus allowing a seam- 

1899) prepared in system controDer 1530 is additionally less, continuous output (free from any wait time upon 

recorded in control information 101 1 changing the still picture to be displayed, or free from 

(RTR.IFO/RTRJVMG) on optical disc 1001 using infor- any interrupt of audio information). This is a great fea- 

mation recording/ reproducing unit 101 (ST10). 20 ture of this invention. 

[02t7] The playback sequence of still picture informa- [0226] In FIG. 22 described above, after audio infor- 

tion containing audio information will be described mation in VOB#B is reproduced, still picture information 

below with the aid of FIG. 22. in VOB#A is reproduced. However, a modification may 

[0218] As in steps ST4 and ST5 in FIG. 20. informa- be made without departing from the scope of the 

tion recordng/reproducing unit 101 reproduces all 25 present invention (e.g.. the reproduction order maybe 

pieces of control information 1011 replaced). 

(RTRJFO/RTR_VMG) recorded on optical disc 1001. [0227] In the recording format shown in FIGS. 10Ato 

and saves the reproduced contents in the internal RAM 10L. a pair of still picture information and audio informa- 

of system controller 1 530 (ST1 1 ). tion are saved in a VOBU. However, the present inven- 

[021 9] System controller 1 530 obtains information of 30 tion is not limited to such specific format The contents 

playback control information 1021 (CI) from the con- of the present invention can be applied as long as the 

tents of control information 1011 saved in its internal scope of the invention is implemented. 

RAM, and interprets the obtained information as to the [0228] For example, in case of a recording format in 

manner of reproduction (ST1 2). which V_PCKs for a plurality of still pictures may be allo- 

[0220] After that, system controller 1530 searches for 35 cated in one VOB or in the first naff of one PTT, and 

a program of information to be reproduced from PGC A_PCKs for a plurality of still pictures are allocated in 

control information 1103 (PGCI) saved in its internal the second half, the positions of V_PCK and A_PCK of 

RAM. and extracts a cell or cells contained in that PGC a still image of a given number are separated from each 

information (ST13). other on information storage medium (optical disc) 

[0221] Furthermore, system controller 1530 extracts 40 1001. Hence, even when still picture information 

the recording address of the VOB to be reproduced on (V_PCK information) and audio information (A_PCK 

optical disc 1001 from video object information 1107 information) with an identical still picture number in one 

(AVFIT) or part_pf_titles information 1753 (FIG. 8) in VOB are reproduced in turn, optical head access is 

video title set information 1106 (RTR_VMGI) saved in required. 

its internal RAM (ST1 4). 45 [0229] Therefore, when a plurality of pieces of still pic- 
[0222] The playback sequence for playing back still ture information are reproduced from picture objects 
picture information from VOB#A and presenting audio 1013 with the recording format in which V_PCKs for a 
information recorded in VOB#B simultaneously with the plurality of still pictures may be allocated in one VOB or 
still -picture upon playback, as shown in FIGS. 1 4 A to in the first half of one PTT. and A_PCKs for a plurality of 
14G. will be explained. so still pictures are allocated in the second half, either 
[0223] An optical head (not shown) in information V__PCK or A_PCK information for a plurality of still pic- 
recording/reproducing unit 101 accesses VOB#B tures is read in advance and saved in memory 1 563. the 
recorded on optical disc 1001 on the basis of a control remaining information is then reproduced, and the 
signal from system controller 1530 to reproduce its reproduction results can be simultaneously output (dis- 
information, and temporarily saves audio information for ss played), according to the sequence of the present 
a plurality of still pictures in that reproduced information invention. 

in memory 1 563 (FIG. 19) (ST18). [0230] As another embodiment of the present inven- 

[0224] The optical head in information recording/ tion, a method of additionally recording additional infer- 
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mation lor a still picture by after recording will be 
explained below with reference to FIG. 21. Information 
to be added by after recording forms a group (another 
VOB or PTT) different from that of original still picture 
information, and the additional information and still pic- 5 
ture information are synthesized and output (displayed) 
by the method shown in FIGS. 14A to 14G- 
[0231] Referring to FIG. 21 , steps ST 1 1 to ST14 are 
the same as those in FIG. 22. The optical head in infor- 
mation recording/reproducing unit 101 accesses a VOB 10 
recorded on optical disc 1001 to reproduce its informa- 
tion, and the display contents shown in FIG. 1 1 are sup- 
plied to AV output 1546 (ST18). Additional information 
input by the user while observing the display screen is 
received, and a plurality of still pictures are grouped by is 
formatter 1556 on the base of the input information to 
construct a VOB or PTT (ST1 9). 

[0232] Finally, VOB information constructed by format- 
ter 1556 is recorded on optical disc 1001 (ST20). 
[0233] FIG. 23 is a view for explaining the data struc- 20 
ture of navigation data (RTR_VMG) shown in FIG. 8. 
This RTR_VMG corresponds to control information 
1 101 and information 1021 in FIG. 1 E, and corresponds 
to control information (RTRJFO) 1011 in the file struc- 
ture shown in FIG. 2. 25 
[0234] Of this navigation data RTR_VMG, user 
defined PGC information table UD_PGClT is comprised 
of user defined PGC information table information 
(UD_PGCm), one or more user defined PGC informa- 
tion search pointers #1 to #n (UD_PGCI_SRP#1 to 30 
UD_PGCl_SRP#n). and one or more pieces of user 
defined PGC information #1 to #n (UD_PGCI#1 to 
UD_PGCI#n) corresponding in number to these search 
pointers. 

[0235] Each user defined PGC information (one of 35 
UD_PGCI#1 to UD_PGCI#n) or PGC information # 
(PGCI#i) having contents corresponding to original 
PGC information (ORG_PGCI) is composed of PGC 
general information (PGCJ3I). one or more pieces of 
program information #1 to #m (PGttM to PGI#m), one or 40 
more cell information search pointers #1 to #n 
(CI_SRP#1 to CLSRP#n), and one or more pieces of 
cell information #1 to #n (Cl#1 to Cl#n) corresponding in 
number to these search pointers. 

[0236] Each cell information search pointer (one of 45 
GI_SRP#1 to CI_SRP#n) contains the start address 
(CLSA) of corresponding cell information, and each cell 
information (one of Cl#1 to Cl#n) contains movie cell 
information (M_CI) or still picture cell information 
<S_CI). so 
[0237] Note that RTR__VMGI in FIG. 23 corresponds 
to video title set information 1106 in FIG. IF. M__AVFIT 
and S_AVFIT in FIG. 23 correspond to video object 
information 1107 in FIG. 1F. and ORG_PGCI and 
UD_PGCIT in FIG. 23 correspond to PGC control infer- 55 
mation 1103 in FIG. 1F. 

[0238] On the other hand, PGCI#i in FIG. 23 corre- 
sponds to PGC control information 1103 in FIG. 1F, and 



Cl&in FIG. 23 corresponds to cell playback information 
1108 in FIG. IF 

[0239] FIGL 24 is a view for explaining the contents of 
still picture cefl information (S_CI) in FIG. 23. S_CI con- 
tains still picture cell general information (S_C_GI), and 
one or more pieces of still picture cell entry point infor- 
mation #1 to #n (S_C_EPI#1 to S_C_EPI#n). Note that 
S_CI in FIG. 24 corresponds to cell playback informa- 
tion 1108 in FIG. 1F. 

[0240] FIG. 25 is a view for explaining the contents of 
still picture cell general information (S_CJ3I) in FIGL 24. 
[0241 ] This S_CjGI contains a cell type (C_TY) which 
describes the type of cell, the still picture VOB group 
information search pointer number (S_VOGI_SRPN) of 
the VOB group used by this ceH, the number 
(C_EPI_Ns) of pieces of cell entry point information in 
this cell, the start address (S_S_VOB_ENTN) of the still 
picture VOB entry number of this cell, and the end 
address (E_S_VOB_ENTN) of the still picture VOB 
entry number of this cell. 

[0242] Note that S_S_VOB_ENTN in FIG. 25 corre- 
sponds to still picture number 1875 in VOB in FIG. 15, 
and E_S_VOB_ENTN in FIG. 25 corresponds to still 
picture number 1876 in a VOB in FIG. 15. 
[0243] FIG. 26 is a view for explaining the contents of 
each still picture cell entry point information (S__C_EPI) 
in Fia 24. This S_C_EPI has two different types (type 1 
and type 2). 

[0244] S_C_EPl of type 1 contains an entry point type 
(EP_TY) that descrfoes the type of entry point, and still 
picture VOB entry number (S_VOB_ENTN). 
[0245] S_C_EP! of type 2 further contains primary text 
information (PRMJTXTI) in addition to EPJTY and 
S_VOB_ENTN. This PRMJTXTI can record a comment 
and other information associated with the correspond- 
ing still picture. 

[0246] Note that S_VOB_ENTN in FIG. 26 is number 
information which specifies each of one or more still pic- 
ture VOB entries S_VOB_ENT# (corresponding to 
VOBUmap 1738 for picture objects in FIGS. 12 and 13, 
or VOB map 1899 for picture objects in FIG. 17). 
[0247] FIG. 27 is a view for explaining the contents of 
still picture additional audio file information (S_AAFI) in 
FIGL12. 

[0248] This S_AAFI contains still picture additional 
audio file information general information (S_AAFI_GI), 
one or more still picture additional audio group informa- 
tion search pointers #1 to #n (S_AAGI_SRP#1 to 
S_AAGI_SRP#n), and a plurality of pieces of still picture 
additional aucfio group information #1 to #n (S_AAGI#1 
to S_AAGI#n) corresponding in number to these search 
pointers. 

[0249] Each still picture additional aucfio group infor- 
mation (one of S_AAGI#1 to S_AAGI#n) contains still 
picture additional audio group general information 
(S_AAG_GI), and one or more additional audio entries 
#1 to #n (AA_ENT#1 to AA_£=NT#n). 
[0250] FIG. 28 is a view for explaining the contents of 
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S_AA_GI general information (S_AAG_GI) in FIG. 27. 
[0251] This S_AAG_GI contains the number 
(AA ENT_Ns) of additional audio entries, the still pic- 
ture additional audio stream information number 
(S_AA_STIN), and the start address (S_AAG_SA) of 
AAG in a still picture additional audio file. 
[0252] Note that AA_ENT_Ns in FIG. 28 assumes a 
value corresponding to number 1801 of still pictures in a 
VOB in FIG. 13 or number 1901 of still pictures in PTT 
in FIG. 18. 

[0253] S_AAG_SA in FIG. 28 corresponds to the first 
still picture address (first still picture information 1802 in 
a VOB or first V_PCK address 1808 in a VOBU in FIG. 
1 3; or first still picture information 1 902 in a PTT or first 
V_PCK address 1908 in a VOB in FIG. 18). 
[0254] FIG. 29 is a view for explaining the contents of 
the additional audio entry (AAENT) shown in FIG. 27. 
[0255] This AA ENT contains an additional audio type 
(AA_TY) that describes the type of additional audio 
(eg., normal one or tentatively created one), the size 
(AA_SZ) of an additional audio stream, and the play- 
back time (AA_PB__TM) of the additional audio stream. 
[0256] Note that AA_S2 in FIG. 29 assumes a value 
corresponding to the difference between the A_PCK 
address of the current additional audio (first A_PCK 
address 1812 in a VOBU in FIG. 13 or first A_PCK 
address 1912 in a VOB in FIG. 18). and the A_PCK 
address of the next additional audio (1812 in FIG. 13 or 

1912 in FIG. 18). 

[0257] On the other hand, AA_PB_TM in FIG. 29 cor- 
responds to the difference obtained by subtracting 
audio S_PTM 1813 from audio E_PTM 1814 in FIG. 13 
(or the difference obtained by subtracting audio S_PTM 

1913 from audio E_PTM 1914 in FIG. 18). 

[0258] FIG. 30 is a view for explaining the contents of 
still picture VOB group general information (S_VOG_Gf) 
shown in FIG. 12. 

[0259] This S_VOG_GI contains the number 
(S_VOB_Ns) of still pictures that describes the number 
of video parts in the corresponding VOB group, the 
number (S_VOB_STIN) of pieces of still picture VOB 
stream. information, the time (Fl RST_VOB_REC_TM) 
when the first VOB in that VOB group was recorded, the 
time (LAST_VOB_REC_TM) when the last VOB in that 
VOB group was recorded, and the start address 
(S_VOG_SA) of that VOB group in a still picture AV file. 
[0260] Note that S_VOB_Ns in FIG. 30 has a value 
corresponding to number 1901 of still pictures in a VOB 
in FIG.. 13 or number 1901 of still pictures in a PTT 
shown in FIG. 18. 

[0261] Also. S_VOG_SA in FIG 30 corresponds to the 
first still picture address (first still picture information 
1802 in a VOB or first V_PCK address 1808 in a VOBU 
in FIG. 13; or first still picture information 1902 in a PTT 
or first V_PCK address 1908 in a VOB in FIG. 18). 
[0262] FIG. 31 is a view for explaining the first exam- 
ple (type 1) of the contents of still picture VOB entry 
(S_VOB_ENT) in FIGL 12. 



[0263] This S_VOB_ENT of type 1 contains a still pic- 
ture VOB entry type (S_VOB_ENT_TY) that describes 
the type of still picture VOB entry, and the size 
(V_PART_SZ) of the corresponding still picture video 
5 part. 

[0264] Note that S_VOB_ENT_TY contains informa- 
tion MAPJTY that describes the type of S_VOB_ENT. 
information TE that describes whether the correspond- 
ing VOB is normal or tentatively erased (temporarily 
10 erased), and information SPST_Ns that describes the 
number of sub-picture streams contained (if it is zero, no 
streams are contained). 

[0265] On the other hand, V_PART_SZ describes the 
size of the video part in that VOB in units of sectors. 

is [0266] This V_PART_SZ corresponds to the differ- 
ence between the address (1808 in FIG. 13) of the first 
V_PCK in the current still picture VOBU, and the 
address (1812 in FIG. 13) of the first A_PCK in the cur- 
rent still picture VOBU. 

20 [0267] Or this V PART SZ corresponds to the differ- 
ence between the address (1908 in FIGL 1 8) of the first 
V_PCK in the current still picture VOB, and the address 
(1912 in FIG. 18) of the first A_PCK in the current still 
picture VOB. 

25 [0268] FIG. 32 is a view for explaining the second 
example (type 2) of the contents of still picture VOB 
entry (S_VOB_ENT) in FIG. 12. 
[0269] This S_VOB_ENT of type 2 contains 
A_PART_SZ that incficates the size of the audio part 

30 which is originally attached to the still picture VOB in 
units of sectors, and A_PB_TM that indicates the play- 
back time of the audio part in units of video fields, in 
addition to S_VOB_ENT_TY and V_PART_S2 of type 1 
shown in FIG. 31. 

35 [0270] When the playback time of an actual audio part 
does not match a boundary of video fields, data after 
the video field of end data of the audio part is discarded. 
[0271 ] Note that A_PART_SZ corresponds to the dif- 
ference between the first A_PCK address (1812 in FIG. 

40 13) in the current VOBU. and the first V_PCK address 
(1808 in FIG. 13) in the next VOBU. 
[0272] Or A_PART_SZ corresponds to the difference 
between the first A_PCK address (1912 in FIG. 18) in 
the current VOB, and the first V_PCK address (1908 in 

45 FIG. 1 8) in the next VOB. 

[0273] On the other hand, A_PB_TM corresponds to 
the difference between current S_PTM 1810; FIGL 13 
(or current S_Flifl 1910; FIG. 18). and next S_PTM 
1810; FIG. 13 (or next S_PTM 1910; FIG. 18). 

so [0274] Or A_PB_TM corresponds to the difference 
between S_PTM 1813 and E_PTTv1 1814 in FIG. 13 (or 
the difference between S_PTM 1913 and E_PTM 1914 
in FIG. 18). 

[0275] FIGL 33 is a view for explaining the third exam- 
55 pie (type 3) of the contents of still picture VOB entry 
(S_VOB_END in FIG. 12. 

[0276] This S_VOB_ENT of type 3 contains the still 
picture additional audio group number (S_AAGN) and 
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additional audio entry number (AA ENTN) in adcfition to 
S_VOB_ENTJY and V_PART_SZ of type 1 shown in 
FIG. 31. 

(02771 Note that S_AAGN indicates the number of 
additional audio group that contains the additional audio 5 
stream of the corresponding VOB. This S_AAGN corre- 
sponds to ID information 1877 of a VOB having A_PCK 
in FIG: 15. 

[0278] On the other hand, AA ENTN indicates the 
number of additional audio entry corresponding to the 10 
additional audio stream of the corresponding VOB. This 
AA_ENTN corresponds to still picture number 1878 in a 
VOB that contains A_PCK of the first still picture in a cell 
in FIG. 15. 

[0279] FIG. 34 is a view for explaining the fourth 15 
example (type 4) of the contents of still picture VOB 
entry (S_VOB_ENT) in FIG. 12. 

[0280] This S_VOB_ENT of type 4 has contents that 
combine S_VOB_ENT_TY and V_PART_SZ of type 1 
shown in FIG. 3 1 . A_PART_SZ and A_PB_TM of type 2 20 
shown in FIG. 32, and S_AAGN and AA_ENTN of type 
3 shown in FIG. 33. 

[0281] In entries S_VOB_ENT of types 1 to 4 shown 
in FIGS. 31 to 34, the same field names 
(S_VOB_ENT_TY and the like) have the same con- 25 
tents. 

[0282] FIG. 35 is a view for explaining the relationship 
between the original PGC information (ORG_PGC1 in 
FIG. 8 or 23) and still picture video file (RTR_STO.VRO 
in FIG. 2) when only still picture VOBs are recorded. 30 
[0283] In an original PGC where only still picture 
VOBs are recorded, the PGCI consists of a sequence of 
cells, and each cell corresponds to a stall picture VOB 
group. Stall picture VOB group is introduced to reduce 
the navigation data size associated with each still pic- 3S 
ture VOB, considering when a huge number of still pic- 
ture VOBs are recorded. However, a cell is unable to 
refer to both movie VOB and still picture VOB at the 
same time. Therefore, if a movie VOB and a stall picture 
VOB is recorded alternatively, a still picture VOB group 40 
may contain only one still picture VOB. 
[0284] Assume that still picture VOB group information 
S_VOGI#2 in FIG. 35 corresponds to VOBs 1631 to 
1633 in FIGS. 1 0A to 10L. 

[0285] Under this assumption, for example, VOBU 45 
1641 in FIG. 10B, VOBU 1644 in FIG. 10E. and VOBU 
1646 in FIG. 10H are contained in S_VOG»#2. The 
video part in still picture VOB group #2 in FIG. 35 corre- 
sponds to packs 1661 to 1663 and 1681 in FIG. 10C. 
pack 1665 in FIG. 10F, or packs 1 668 to 1 670 and 1 683 so 
in FIG. 101. 

[0286] Also, assume that S_VOGI#2 in FIG. 35 corre- 
sponds to VOB#Ain FIG. 14A 
[0287] Under this assumption, for example, still picture 
number 2 of VOBU 1862 in FIG. 14B corresponds to 55 
VOB entry number 2 of S_VOGI#2, packs 1852, 1848, 
and 1862 of still picture 1832 in FIG. 14C correspond to 
central video and audio parts of the RTRjSTO.VRO ffle 



in FIG. 35. and pack 1853 of still picture 1833 in FIG. 
14C corresponds to a trailing video part of the 
RTRJSTO.VRO file. 

[0288] FIG. 36 is a view for explaining the relationship 
between the original PGC information (ORG_PGCI) 
and still picture additional audio part ( RTR_STA. VRO in 
FIG. 2). 

[0289] VOB entry contains access information to the 
associated video part and the audio part both of which 
are recorded in the RTR_STO.VRO file. The audio part 
is recorded immediately after the associated video part. 
When an additional audio part associated with a video 
part is recorded in RTR_STA.VRO file, an additional 
audio entry is described in data fields other than the 
VOGI, and a (ink from the VOB entry to the additional 
audio entry is descrfced in the VOB entry, 
[0290] Assume that additional audio file 

RTR_STA.VRO in FIG. 36 corresponds to VOB#B in 
FIG. 14G. 

[0291 ] Under this assumption, for example, the arrow 
from A_PCKs 1865 and 1866 in FIG. 14D to A_PCKs 
1865 and 1866 in FIG. 14E corresponds to that from a 
VOB entry in S_VOGI#2 in FIG. 36 to its right neighbor- 
ing additional audio entry. 

[0292] In this case, paying attention to the arrow of 
A_PCK 1866. A_PCK 1866 in FIG. 14E corresponds to 
the central audio part of RTR_STA. VRO in FIG. 36. and 
still picture number h+j-2 in FIG. 14F constructs a part 
corresponding to A_PCK 1866 of the additional audio 
entry in FIG. 36. 

[0293] The information parts (the VOB entry and adcfi- 
tional audio entry in FIG. 36) connected by the arrow 
can be linked using cell playback information 1 108 in 
FIG. 1ForS_ClinFIG. 24. 

[0294] When the central audio part in the 
RTRJSTA.VRO file in FIG. 36 is audio information of 
after recording, A_PCK 1 866 in FIG. 1 4E corresponding 
to this audio part can be constructed using dummy pack 
DM_PCK shown in FIG. 3F. 

[0295] FIG. 37 is a view for explaining an example of 
the structure of original PGC information (ORG_PGCI 
in FIG. 8 or 23) that contains still picture VOBs 
(RTRJSTO.VRO ffle) and movie VOBs (RTRJvlOV. VRO 
ffle). 

[0296] Assume that program #1 of PGCI#1 in FIG. 37 
corresponds to VTS 1762 in FIG. 9E, S_VOGI#1 and 
S_VOGI#2 correspond to VOB#D 1774 and VOB#E 
1775 in FIG. 9F, and M_VOBI#1 and M_VOBI#2 corre- 
spond to VOB#A 1771 and VOB#B 1772 in FIG. 9F. 
[0297] Under this assumption, picture object 1013 in 
FIG. 9F constructs the contents (video and audio parts) 
of the RTR_STO.VRO file in FIG. 37, and video object 
1012 in FIG. 9F constructs the contents (VOB#1, 
VOB#2,...) of the RTR^MOV.VRO file in FIG. 37. 
[0298] Referring to FIG. 37, ce«# in PGCI and VOB 
entries in S_VOGI# can be finked using, e.g.. 
S__S_VOB_ENTN and E_S_VOB_ENTN in FIG. 25. 
[0299] On the other hand, the logical addresses of the 
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video or audio part in the RTR_STO.VRO file, and VOB 
numbers designated by VOB entries in S_VOGI# can 
be linked using the relationships shown in, e.g.. FIGS. 4 
and 5. 

[0300] TimemapTMAPinM_VOBI#inFIG.37willbe 
explained below. 

[0301] Movie AV file information table M_AVFIT in 
FIG. 8 or 23 contains movie AV file information general 
information (M_AVFI_GI), one or more movie VOB infor- 
mation search pointers (M_VOB1_SRP#1 to 
M_VOBI_SRP#n). and one or more pieces of movie 
VOB information (M_VOBI#1 to M_VOBI#n) corre- 
sponcfing in number to these search pointers (not 
shown). 

[0302] Each M_VOBI# contains movie VOB general 
information (M_VOBI_GI), seamless information 
(SMU), audio gap information (AGAPI), and time map 
inform a tion (TMAPf) (not shown). 
[0303] This TMAPI is used upon executing special 
playback (e.g., cell playback in the order unique to the 
user using user defined PGC) and time search. 
[0304] TMAPI contains time map general information 
(TMAP_GI), one or more time entries (TMENT#1 to 
TM_ENT#r). and one or more VOBU entries 
(VOBU_ENT#1 to VOBU_ENT#q) (not shown). 
[0305] Each VOBU entry contains information that 
pertains to the size and playback time of each VOBU. 
The VOBU size is indicated in units of sectors (2 kbytes 
or 2,048 bytes), and the playback time is indicated in 
units of video fields (1/60 sec per field in NTSC; 1/50 
sec per field in PAL). 

[0306] Since the VOBU size is indicated in units of 
sectors, as described above, each VOBU can be 
accessed using an address in units of sectors. 
[0307] Each VOBU entry contains reference picture 
size information 1STREF_SZ, VOBU playback time 
information VOBU_PB_TM. and VOBU size information 
VOBU_SZ (not shown). 

[0308] Note that VOBU_PB_TM expresses the play- 
back time of the VOBU of interest in units of video fields. 
On the other hand, reference picture size information 
1STREF_SZ expresses the size of the first reference 
picture (corresponding to l-picture of MPEG) of that 
VOBU in units of sectors. 

[0309] On the other hand, each time entry contains 
address information (VOBU_ADR) of the corresponding 
VOBU, and time difference information (TM_DIFF) (not 
shown). This time Difference information indicates the 
difference between the playback time designated by a 
time entry, and the playback start time of the VOBU. 
[031 0] Assuming that the time interval (time unit TMU) 
between two successive time entries is 10 sec. this time 
entry interval corresponds to. e.g.. 600 fields in NTSC 
video. 

[031 1 ] Normally, the time interval between neighbor- 
ing VOBUs" is expressed by the number of fields in the 
VOBU entry. As another method, "count value from a 
given VOBU to the next VOBU by a clock counter may 



be used to express the "time interval between neighbor- 
ing VOBUs". 

[0312] For example, the "time interval between neigh- 
boring VOBUs" can be expressed by the "difference 
5 value between the value of presentation time stamp 
PTS at the start position of one VOBU and the value of 
PTS at the start position of the immediately succeeding 
VOBU". 

[0313] In other words, "the time interval in a specific 
io unit can be expressed by the difference value erf the 
clock counter in that unit". 

[0314] Time map generation information TMAPjGI 
includes TM_ENT_Ns indicating the number of time 
entries in that time map information, VOBU_ENT_Ns 
is indicating the number of VOBU entries in that time map 
information, time offset TM OSF for mat time map infor- 
mation, and address offset ADRJDFS of that time map 
information (not shown). 

[0315] When a value (10 seconds or equivalent) cor- 
20 responding to 600 f ields in NTSC video (or 500 fields in 
PAL video) is used as time unit TMU. time offset 
TMOSF is used to represent the time offset within 
TMU. 

[0316] When the VOBU size is expressed by the 
25 number of sectors, address offset ADR_OFS is used to 

indicate a file pointer from the beginning of an AV file. 

[0317] Time entry TM_ENT includes VOBU_ENTN 

indicating the number of the corresponding VOBU entry. 

TM_DlFF indicating the time difference between the 
30 playback start time of VOBU designated by the time 

entry, and the calculated playback time, and 

VOBU_ADR indicating the target VOBU address (not 

shown). 

[0318] When time unit TMU is expressed by 600 fields 
35 in NTSC (or when time unit TMU is expressed by 500 
fields in PAL), the "calculated playback time" with 
respect to time entry #j is given by 
TMU x(j-1) + TM_OSF. 

[0319] On the other hand. VOBU_ADR indicates the 
40 target VOBU address by the total size of VOBUs pre- 
ceding the VOBU of interest when the VOBU size is 
expressed in units of sectors. 

[0320] In the aforementioned data structure, in order 
to start playback from the middle of a certain VOBU, that 

45 access point must be determined. This access point is 
assumed to be a time entry point. 
[0321] This time entry point is located at a position 
separated from the position indicated by movie address 
information of the VOBU by the time difference indicated 

so by time difference information TMJ3IFF in time entry 
TM_ENT. This time entry point serves as a special pres- 
entation start point (or time search point) indicated by 
time map information TMAPI. 

[0322] CeH# in PGCI in FIG. 37 and time map TMAP 
55 in M_VOBl# can be finked in the same manner as 
S_VOGI#. 

[0323] FIG. 37 illustrates a case that a video field cor- 
responding to the presentation start time is in the middle 
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of VOBLWfr. In order to display a sequence of video 
fields from a video field specified by the presentation 
start time, the VOBU data from the beginning need to be 
input to the decoder. This is because the decoder need 
to decode all of the reference video fields which have 5 
presentation time earlier than the presentation start 
time, although the decoded fields should not be dis- 
played. When the decoding reaches to the video field 
corresponding to the presentation start time, the 
decoder should start display of the video pictures. This 10 
capability to start display exactly at the video field corre- 
sponding to the presentation start time is recom- 
mended. 

[0324] FIG. 38 is a view for explaining a case wherein 
user defined PGC Information (F1GL 6) refers to a still 15 
picture VOB group. 

[0325] A user defined PGC may include two types of 
cells, each of which refers to a movie VOB or a still pic- 
ture VOB group, respectively. FIG. 38 shows an exam 
pie of user defined PGC which refers to still picture 20 
VOB. In toe figure. cell#1 in the user defined PGC refers 
to still picture VOB group #2. Although the cell#2 in the 
original PGC refers to the whole still picture VOB group 
#2 by specifying the first still picture VOB number and 
the last still picture VOB number in the still picture VOB 25 
group, the cell#1 in the user defined PGC refers to only 
a still picture VOB in the VOB group by specifying the 
second still picture VOB as the first still picture VOB 
number and the last still picture VOB number. 
[0326] Assume that PGCI in FIG. 38 corresponds to 30 
PGC (or PGCI) 1446 in FIG. 3H. In this case, cell#1 and 
cell#2 in PGCI in FIG. 38 correspond to cells 1441 and 
1 442 in FIG. 3G. On the other hand, the first video part 
in tfie RTRjSTO VRO file in FIG. 38 corresponds to a 
cluster of VPCK 1421 and SP_PCK 1422 in FIG. 3F. 35 
Furthermore, a video part that follows the first video part 
corresponds to a cluster of A_PCK 1423 and DM_PCK 
1424 in FKx 3F. 

[0327] The characteristic features of the respective 
embodiments of the present invention will be summa- ao 
rized below. 

[0328] T One VOB or PTT can contain a plurality of 
pieces of still picture information. 
[0329] T Upon recording a plurality of still pictures, 
one VOB can continuously record at least two pieces of 45 
still picture information in an unrecorded area. 
[0330] T Cell information (S_CI) can designate a plu- 
rality of pieces of continuous still picture information. 
[0331] The effects of these three "~*s are common to 
the respective embodiments. so 
[0332] More specifically, a high-performance digital 
camera can record several thousand or several ten 
thousand still pictures. Upon transferring data to an opti- 
cal disc, the data are preferably grouped and recorded 
on the optical disc in units of a plurality of still pictures. 55 
thus allowing easy processing and attaining short trans- 
fer time. 

[0333] A high-performance digital camera can record 



several thousand or several ten thousand still pictures. 
When VOB information is prepared by constructing a 
VOB for each still image, management information has 
a huge size. The method of the present invention can 
greatly reduce the management information size. 
[0334] Furthermore, since each still picture informa- 
tion forms a different file in the digital camera, manage- 
ment and search processes are cumbersome. In the 
present invention, since still pictures are grouped hi 
units of a plurality of pictures, management and search 
processes are easy. 

[0335] Since each still picture information forms a dif- 
ferent file in the digital camera, the contents of a still pic- 
ture cannot be confirmed unless each file is opened. In 
the present invention, the user can confirm contents as 
if he or she checked a positive film (or negative film) of 
photographs, as shown in FIG. 1 1, by grouping still pic- 
tures in units of a plurality of pictures. 
[0336] Furthermore, video information that stretches 
across a plurality of video frames is recorded in units of 
VOBs. When a plurality of stilt picture information are 
recorded in units of VOBs. video information and still 
picture information can be processed in a single layer 
(in a single directory level in FIG. 2). For example, cells 
of both video information and still picture information 
can be allocated in a single PGC. thus allowing mixed 
display of video information and still picture information, 
and broadening the expression range. 
[0337] *] In the embodiment of the present invention, 
the VOBU map (S_VOB_ENT#) or VOB map is pre- 
pared. 

[0338] *] The RTR recorder has an arrangement capa- 
ble of recording the VOBU map or VOB map. 
[0339] The effects of these two w *"s are common to the 
respective embodiments. 

[0340] The user can directly access a still picture he 
or she wants to watch using the VOBU map or VOB map 
that records information such as recording addresses in 
units of still pictures, and the access speed tor display- 
ing a plurality of still pictures can be greatly improved. 
[0341 ] When a plurality of still pictures are to be con- 
tinuously dSsplayed, seamless display (with continuous 
joints among still pictures) can be achieved using pres- 
entation time information PTM and/or system clock ref- 
erence information. 

[0342] Furthermore, since the start addresses of 
V_PCK that records astill picture itself and A__PCK that 
records audio information are descrfoed at different 
locations, high-speed access can be made if only still 
picture information or audio information is to be played 
back As a result when audio information in a specific 
VOB is used to display still picture in another VOB 
(since audio information alone can be accessed at high 
speed), seamless display can be made. 
[0343] 1 In the present invention, cell information 
(S_CI) designates each still picture in a VOB. 
[0344] For this reason, sjnce each still picture itself 
can be designated upon playback (using the VOBU map 
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or VOB map), high-speed access can be performed, 
and seamless display can be made when a plurality of 
stll pictures are to be displayed in turn. 
[0345] Since each still picture itself can be designated 
upon playback, management upon playback becomes 
very easy. For example, upon displaying a plurality of 
still pictures on the screen at one time, as shown in FIG. 
1 1 . the processing to be executed becomes simple. 
[0346] *] In the present invention, cell information 
(S_CI) can designate a plurality of pieces of still picture 
information in different VOBs. 

[0347] For this reason, since continuous audio infor- 
mation in one VOB can be used upon displaying 
another VOB, the expression range can be broadened. 
[0348] Furthermore, since continuous audio informa- 
tion in one VOB can be used upon displaying another 
VOB, common data can be used and, hence, the data 
size to be recorded on the information storage medium 
(optical disc 1001) can be reduced. As a result, the 
actual data size that can be recorded per information 
storage medium (optical disc 1001) can be greatly 
increased. 

[0349] By only preparing new video object information 
for picture objects (S_AVFIT) corresponding to the 
already recorded video information, the existing video 
information can be used in combination with still picture 
information without modifying video objects 1012 them- 
selves. 

[0350] T In the present invention, cell information is 
reproduced, and a still picture is played back using 
VOBL 

[0351] As a consequence, since cell playback infor- 
mation for picture objects (S__CI) can be set independ- 
ently of video object information for picture objects as 
management information of the contents of picture 
objects 1013, the playback order can be designated 
irrespective of the recording order of still pictures on the 
inform a tion storage medium (optical disc 1001), thus 
remarkably improving the degree of freedom in expres- 
sion. 

[0352] *] The present invention provides an apparatus 
which reads exit still picture information or audio infor- 
mation from a memory, and can simultaneously play 
back the still picture information and audio information. 
[0353] When a plurality of pieces of still picture infor- 
mation in different VOBs are to be designated, or when 
audio information alone for a plurality of still pictures is 
recorded on another area, if V_PCK, SP_PCK. and 
A_PCK are played back in turn in units of stilt pictures, 
the frequency of access becomes very high, and it is 
hard to continuously display a plurality of still pictures in 
turn (due to the influence of the access wait time of the 
optical head). 

[0354] By contrast when information contents for at 
least two still pictures of V_PCK. SP_PCK. and A_PCK 
are played back at the same time, and are temporarily 
saved in memory 1 563. and the stored contents are dis- 
played simultaneously with the playback timing of the 



remaining information, the frequency of access of the 
optical head can be greatly reduced, thus allowing easy 
continuous display. 

[0355] 1 The present invention provides an after 
5 recording apparatus for recording additional information 
to already recorded still pictures. 
[0356] For example, when still picture information 
sensed by a digital camera having no audio input func- 
tion is directly recorded on the information storage 
10 medium (optical disc 1001), the recording result has a 
structure which does not contain any A_PCK (audio 
pack), as shown in FIG. 101. A case will be examined 
below wherein the recorded information is played back, 
and comments are added to still pictures one by one by 
15 "audio input via a microphone", "overwriting marks by 
handwriting*', "addition of text information by key-in", 
and the like, while displaying them on the screen, as 
shown in FIG. 1 1 . In this case, when the recording for- 
mat is to be changed from the structure that does not 
20 contain any A_PCK shown in FIG. 101 to a structure that 
contains A_PCK shown in FIG. 10F, re-recording must 
be done on the information storage medium (optical 
disc 1001). resisting in cumbersome processes and a 
long processing time. By contrast when additional infor- 
ms mation alone is recorded as another VOB 1634 on the 
information storage medium (optical disc 1001), as 
shown in FIG. 10J. without modifying the data that does 
not contain any A_PCK (audio pack) shown in FIG. 101. 
information can be added to a still image very easily and 
30 quickly later. 

[0357] The characteristic features included in the sys- 
tem of the present invention will be described in more 
detail below. 

[0358] Accorcfing to the present invention, an infer ma- 
35 tion storage medium which is capable of recording and 
playing back at least still picture information, and contin- 
uously records a plurality of still pictures, is character- 
ized by having a first information unit [VOBUs 1641 to 
1649] having one still picture information, and a first 
40 groip unit [VOBs 1632 to 1634 or PTTs 1407 and 1408] 
which is comprised of a set of first information units, and 
has a plurality of pieces of still picture information hav- 
ing different contents, and recording information in the 
first group unit 

45 [0359] Note that the still picture information includes 
at least one of video information [V_PCK 1664 and the 
like], sub-picture information [SP_PCK 1682 and the 
like], and audio information [A_PCK 1693 and the like]. 
[0360] The first information unit is constructed by. at 

so least one of a VOBU (video object unit) and VOB (video 
object), and the first group unit is constructed by at least 
one of a VOB (video object) and PTT (part_pf_trtie). 
[0361] An information recorcfing/playback apparatus 
according to the present invention, which is capable of 

55 recording and playing back still picture information 
on/from an information storage medium, comprises an 
unrecorded area detection unit [system controller 1530] 
for searching for an unrecorded area [unrecorded area 
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1460] on the information storage medium, a still picture 
grouping unit [formatter 1556] for grouping a plurality of 
pieces of input still picture information, and an informa- 
tion recording/reproducing unit [information record- 
ing/reproducing unit 101] for recording the plurality of 5 
pieces of grouped stilt picture information on the unre- 
corded area of the information storage medium 
detected by the unrecorded area detection unit. At least 
two pieces of still picture information {e.g.. VOBUs 1642 
and 1643] of the plurality of pieces of grouped still pic- 10 
ture information are continuously recorded in nearby 
areas [e.g., continuously recorded in extents 1474] on 
the information storage medium. 

[0362] An information recording/playback apparatus 
according to the present invention, which is capable of 15 
recording and playing back still picture information 
on/from an information storage medium, has a first 
recording area (picture objects 1013] for recording still 
picture information itself, and a second recording area 
[control information 1011] for recording management 20 
information that pertains to a still picture. This informa- 
tion storage medium [optical disc 1001] has a first infor- 
mation unit [VOBUs 1641 to 1649] having one still 
picture information, and a first group unit [VOBs 1632 to 
1634 or PTTs 1407 and 1408] which is comprised of a 25 
set of first information units, and has a plurality of pieces 
of still picture information having different contents. Still 
picture information is recorded on the first recording 
area in the first group unit, and a plurality of still pictures 
having map information [VOBU map 1738 for picture 30 
objects or VOB map 1899 for picture objects], which 
records management information that pertains to each 
still picture information associated with the first informa- 
tion unit, are continuously recorded 

[0363] An apparatus according to the present inven- 35 
tion, which plays back an information storage medium 
capable of recording and playing back at least still pic- 
ture information, records still picture information and 
management information that pertains to a still picture 
on an information storage medium, which has a first 40 
recording area [picture objects 1013] for recording still 
picture information itself, and a second recording area 
[control information 1011] for recording management 
information that pertains to a still picture. This informa- 
tion recordmg/jplayback apparatus comprises a record- 45 
ing area detection unit [system controller 1530] for 
detecting a location [unrecorded area 1460] where a 
plurality of pieces of still picture information are 
recorded on the information storage medium, a group- 
ing unit [formatter 1556] for forming a first group unit so 
[VOBs 1632 to 1634 or PTTs 1407 and 1408] by collect- 
ing a plurality of first information units [VOBUs 1641 to 
1649] each having one still picture information, an infor- 
mation recording/reproducing unit [information record- 
ing/reproducing unit 101] for recording the grouped first 55 
group unit on an area of the information storage 
medium detected by the recording area detection unit a 
management information preparation unit [system con- 



troller 1530] for preparing management information 
[VOBU map 1738 for picture objects or VOB map 1899 
for picture objects] that pertains to still picture image 
information in the first group unit and a management 
information recording unit [information recording/repro- 
ducing unit 101] for recording the management informa- 
tion that pertains to still picture information, and is 
prepared by the management information preparation 
unit in the second recording area [control information 
1011]. 

[0364] An information storage medium according to 
the present invention, which is capable of recording and 
playing back at least still picture information, has a first 
recording area [picture objects 1013] for recording still 
picture information itself, and a second recording area 
[control information 1011] for recording management 
information, and the second recording area has a first 
control information recording field [video object informa- 
tion 1 107] that records information which pertains to a 
recording state of stilt picture information recorded m 
the first recording area on the information storage 
medium, and a second control information recording 
field [playback control information 1021] that records 
information which pertains to a playback method upon 
playing back still picture information recorded in the first 
recording area. In this information storage medium, 
minimum unit information [cell playback information 
1108] for playback of the still picture information is 
recorded in the second control information recording 
field, and the minimum unit information designates a still 
picture itself to be played back [still picture number 1875 
in a VOB that records a video pack of the first still picture 
in a cell, and stilt picture number 1876 in a VOB that 
records a video pack of the last still picture in a cell, or 
still picture number 1885 in a PTT that records the first 
still picture in a cell, and still picture number 1886 in a 
PTT that records a video pack of the last still picture in a 
cell]. 

[0365] Note that the information storage medium has 
a structure in which the minimum unit information [cell 
playback information 1 108] recorded in the second con- 
trol information recording field [playback control infor- 
mation 1021] designates a plurality of pieces of 
continuously recorded still picture information [by desig- 
nating the first and last still picture numbers in a cell, a 
plurality of pieces of still picture information therebe- 
tween can be designated]. 

[0366] On an information storage medium according 
to the present invention, which is capable of recording 
and playing back at least still picture information, a plu- 
rality of pieces of still picture information are recorded in 
the first recording area [video objects 1012] using a first 
information unit [VOBUs 1641 to 1649] having one still 
picture information, and a first group unit [VOBs 1632 to 
1634 or PTTs 1407 and 1408] which is comprised of a 
set of first information units, and has a plurality of pieces 
of still picture information having cfifferent contents. In 
addition, information [video object information 1107] 
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that pertains to a recording state of still pictures 
recorded in the first group unit is recorded in tie first 
control information recording fiefd [control information 
1011]. 

[0367] The minimum unit information [cell layback 
information 1 108] for playback of the still picture infor- 
mation and is recorded in the second control informa- 
tion recording field [playback control information 1021] 
designates a still picture [still picture numbers 1875, 
1876. 1885. and 1886] in a first group [VOBs 1632 to 
1634 or PTTs 1407 and 1408] recorded in the first con- 
trol information recording field [video object information 
1 107] so as to play back still picture information. Also, a 
still picture position (still picture number j: VOBU 1828. 
still picture number h+j-2 : VOBU 1829] in a second 
group [VOB#B 1822] different from the first group 
[VOB#A 1821] recorded in the first control information 
field is designated to simultaneously play back audio 
information or sub-picture information. 
[0368] A playback apparatus according to the present 
invention has an information reproduction means [infor- 
mation recording/reproducing unit 101]. and an informa- 
tion display means [display/input panel 1548 of RTR 
recorder]. The information reproduction means [infor- 
mation recording/reproducing unit 101] reproduces 
information that pertains to a playback method recorded 
in a second control information recording field [playback 
control information 1021]. and then reproduces informa- 
tion that pertains to the recording state on the informa- 
tion storage medium, which is recorded in a first control 
information recording field [video object information 
1 107], on the basis of the reproduction result. After that 
the information reproduction means reproduces still pic- 
ture information recorded in a first recording area [pic- 
ture objects 1013] on the basts of the reproduction 
result and the information display means [AV output 
1546] displays the reproduced information. 
[0369] A playback apparatus according to the present 
invention, comprises a reproducing unit [information 
recording/reproducing unit 101] tor simultaneously 
reproducing, from an information storage medium which 
records a plurality of pieces of still picture information in 
units of groups {VOB#A 1821. VOB#B 1822]. and in 
which the still picture information contains at least one 
of video information [V_PCKs 1852 and 1854], sub-pic- 
ture information [SP_PCK 1848]. and audio information 
[A PCKs 1865 and 1866]. information for at least two 
still pictures [still picture number 2 and still picture 
number 3 (not shown), or still picture number j and still 
picture number j+1 (not shown)] of the video informa- 
tion, sub-picture information, and audio information, a 
storage unit [memory 1563] for temporarBy storing the 
information reproduced by the reproducing unit, and a 
display unit [AV output 1546] for simultaneously display- 
ing information, which is obtained by reproducing the 
remaining information of the video information [V__PCKs 
1852 and 1854]. sub-picture information [SP_PCK 
1848]. and aucSo information [A_PCKs 1865 and 1866]. 



which is not stored in the storage unit, by the reproduc- 
ing unit [information recordrng/reproducing unit 101]. 
and the information stored in the storage unit 
[0370] An after recording apparatus according to the 
5 present invention uses an information storage medium, 
which has a first information unit [VOBUs 1641 to 1649] 
having one still picture information, and a first group unit 
[VOBs 1632 to 1634 or PTTs 1407 and 1408] which is 
comprised of a set of first information units, and has a 
io plurality of pieces of still picture information having dif- 
ferent contents, and continuously records a plurality of 
still pictures in the first group unit The apparatus using 
this medium comprises an additional information input 
means [AV input 1542 -> ADC 1552/ A encoder 1554 or 
15 SP encoder 1555] for adding information to each still 
picture information [VOBUs 1825 to 1827], a temporary 
storage unit [temporary buffer memory 1 534] for tempo- 
rarily storing additional information added to each still 
picture information, an additional information synthesiz- 
ed ing means [formatter 1 556 and data processor 1 536] for 
grouping the additional information added to each still 
picture information into the first group unit [VOBs 1632 
to 1634 or PTTs 1407 and 1408]. and an information 
recording means [information recording/reproducing 
25 unit 101] for recording synthesis information prepared 
by the additional information synthesizing means on the 
iriformation recording medium. 

[0371] As described above, according to the present 
invention: 

30 

A) A new recording format and data structure of 
management information, which can process a plu- 
rality of pieces of still picture information while 
assuring data consistency and continuity of a gen- 

35 era! video recording format and management infor- 
mation in a rewritable DVD_RTR disc which 
assures compatibility and continuity with DVD video 
disc, can be obtained. 

B) A new recording format and data structure of 
40 management information, which can easily manage 

and search a plurality of pieces of recorded still pic- 
ture information, can be obtained. 

C) An information playback apparatus, .which can 
seamlessly and continuously display a plurality of 

45 pieces of still picture information (continuity upon 
playback) by allowing high-speed access to an 
information storage medium that records a plurality 
of pieces ol, stifl picture information, can be 
obtained. 

so 

Claims 

1. An information storage medium capable of record- 
ing and playing back at least still picture information 
55 (RTR_STO.VRT). 

characterized in that me still picture infor- 
mation constructs a first information unit (VOB or 
VOBU). 
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a first group unit (S_VOGI) having a plurality of (S_C_E P l/S_ VOB_E NTN) . 

pieces of still picture information is constructed 

by a set of first information units, and 

one or more pieces of still picture information 

are recorded in the first group unit (S_VOGI). s 

2. A medium according to claim 1, characterized in 
that said medium comprises a first recording area 
for recording still image information 
(RTR_STO.VRO) itself, and a second recording 10 
area for recording first management information 
(RTR_VMG) that pertains to still picture informa- 
tion. 

still picture information is recorded on the first is 
recording area in the first group unit (S_VOGI), 
and 

a plurality of pieces of still picture data having 
second management information (VOBU map 
or VOB map; or S_VOB_ENT) that pertains to 20 
each still picture information associated with 
the first information unit are recorded. 

3. A medium according to daim 1, characterized in 
that said medium comprises a first recording area 25 
for recording still picture information 
(RTR_STO.VRO). and a second recording area for 
recording management information (RTR_VMG) 
containing first control information (S_AVFI) that 
pertains to a recording state of the still picture infer- 30 
mation (RTR_STO.VRO), and second control infor- 
mation (S_CI) that pertains to a playback method of 
the still picture information, and 

minimum unit information 

(SjC_EPI/S_VOB_ENTN) for playing back the still 35 
picture irrfbrmation is recorded in a recording field 
of the second control information (S_CI). 

4. A medium according to any one of claims 1 to 3, 
characterized by further comprising a recording 40 
field (DM_PCK) of after recording information 
(RTR_STAVRO) associated with the still picture 
information (RTR_STO.VRO). 

5- A medium according to any one of claims 1 to 4, 45 
characterized by further comprising a recording 
field (SP_PCK) of sub-picture information associ- 
ated with the still picture information 
(RTR_STO.VRO). 



6. A method of recording one or more pieces of still 
picture information on said medium recited in any 
one of claims 1 to 5 in the first group unit (S_VOGI 
in FIG. 9F). 

7. A method of playing back one or more pieces of still 
picture information from the medium recited in 
claim 3 on the basis of the medium unit information 
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FIG. 26 
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FIG. 28 
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